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ABSTRACT 

This study evaluated an instructional model entitled 
"Integrating Computer Software into the Functional Mathematics 
Curriculum: A Diagnostic Approach," which was intended to prepare 
middle-school special education students for the Maryland Functional 
Mathematics Test. The model consisted of eight major components: 
pretests/posttests, diagnostic evaluations, domain directories, 
software matrix, software summaries, skill sheets, computer software, 
and miscellaneous materials. The model was evaluated by comparing 
math performance and attitudes of students who received Instruction 
based on the model with those of matched control students, and by 
conducting Interviews with teachers using the model. Analysis of 
scores of 26 experimental and 26 comparison subjects on the 9th-grade 
Maryland Functional Mathematics Test indicated that 27% of 
experimental subjects passed the test, while 12% of the comparison 
students passed. Interviews with 17 teachers indicated that teachers 
felt that their students benefited from the model. Scores on the 
attitude test were not correlated with posttest scores, time on the 
computer, or other factors uuder consideration except gender. 
Appendices contain a description of the model components, a data 
recording form, copies of measurement instruments, a reliability 
analysis of measurement instruments, and a report of interview 
responses. (JDO) 
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METHODOLOGY 



Purpose of the Study 

This study was conducted by the Project on Effective 
Computer Instruction for Effective Special Education to evaluate 
an instructional model entitled Integrating Comp u ter Softwar e 
into the Functional Mathematics Curriculu m: A Diagnostic Approach 
(1989) . This model was intended to prepare middle school special 
education students for the Maryland Functional Mathematics Test 
which is given as a graduation requirement to high school 
students in Maryland. The model consisted of eight major 
components: 

1. Pretests/Posttests 

2. Diagnostic Evaluations 

3. Domain Directories 

4. Software Matrix 

5. Software Summaries 

6. Skill Sheets 

7. Computer Software 

8. Miscel] ^ous Materials 

(The eighth component, Miscellaneous Materials, is not included 
in the final version of the instructional model as distributed by 
the school district, but was included in the version used in this 
evaluation study.) These components are described in Appendix A 
of this report. 

The following main evaluation questions were posed: 

1. What effect does the program have on math performance 
and attitudes? 

2. How do teachers use the program? 

Question 1 was answered by means of a comparison study in 
which the math performance and attitudes of students who received 
instruction based on the instructional model were compared with 
the performance and attitudes of matched students from other 
schools in the school district. 

Question 2 was answered by means of a series of structured 
interviews conducted during the course of the academic year in 
schools in which the instructional model was being used. 

The remainder of this report describes (1) the procedures 
followed in this evaluation study, (2) the results of the 
comparison study, and (3) the results of the structured 
interviews . 



Procedures 



Three middle schools were selected as experimental sites on 
the basis of (a) special education program of sufficient size, 
(b) interest in the project expressed by school c\dministrators 
and staff, (c) geographic distribution across the county, (d) 
inclusion of nonmagnet and magnet sites (two and one, 
respectively) . The evaluation activities taking place at these 
three schools are depicted in the timeline in Figure 1 and 
described below. 



Figure 1 

Timeline of Evaluation Activities 

1988 1989 
Month; Sep Oct Nov Dec Jan Feb Mar Apr May Jun 

Use 

lection 

Interviews [=] [=] [=] 

Comparison [==] 
Sample 

Posttest [==] 



9th-Grade Oct, 1989=> 

MFMT 



Model Use 

Project staff members delivered school-based training on the 
use of the instructional model to teachers at the three 
experimental schools. On August 30 and 31, an initial training 
session of 2 1/2 hours was conducted in each school to introduce 
the instructional model and its components. The teachers 
practiced using the materials by scoring a mock diagnostic test 
to identify specific skill deficits. Next, teachers used the 
matrices to identify software activities that correlated with the 
skills. Before viewing the software, they consulted the Software 
Summaries that described the programs. The teachers alscp 
reviewed the Student Progress Sheet (found in the appendix of the 
guide) to visualize how they would develop a plan of computer 



instruction for their students. Each of the participating 
special education teachers received a copy of the instructional 
guide, and each school received the necessary software. 

Subsequent training took place in the new schools prior to 
data collection when the project staff met with the teachers 
individually and in groups. During these sessions project staff 
further explained the model, reviewed software programs, answered 
teachers' questions, and discussed computer management and 
scheduling problems. 

After receiving this training, teachers in the three 
experimental schools were, requested to use the instructional 
model for the remainder of the school year, and (to the degree 
possible) to give each student three computer sessions per week, 
each session of at least 15-minutes duration. Project staff 
members were instructed to answer teacher questions about 
computers and the instructional model, and to provide basic 
levels of support, but to refrain from dealing directly with 
students or becoming directly involved with the instructional 
process . 

Data Collection 

Each week, teachers completed a data form recording their 
students' use of computers (see Appendix B) . These forms, which 
had student names preprinted, recorded the number and length of 
computer sessions and the topic (by Maryland Functional Math Test 
Domain) covered by the computer. Each week, pro"; ect staff 
members visited the schools to distribute new data recording 
forms and collect completed forms. Questions concerning computer 
use and data recording procedures were addressed in these visits. 
This phase of the intervention was 25 weeks in duration, but data 
records for one week were lost leaving a total of 24 weeks' data. 



Interviews 

At three points during the school year, project staff 
members met individually with teachers to conduct a structured 
interview on the use of the instructional rrodel and computers, 
and to obtain general teacher feedback. Each of these interview 
lasted approximately twenty minutes. The first interview 
included only teachers from the three experimental schools, but 
the second and third interviews included teachers from three 
schools involved in the previous yt,ar's activities. These three 
schools had been involved in the development of the model and ha 
been given a complete set of the materials. 

The interview was comprised of questions on each component 
of the model: Pretest, Diagnostic Evaluation, Domain Directory, 
Matrix, Software Summaries, Skill Sheets, Software, and 
Miscellaneous Materials. After each round of interviews, projec 



staff members refined the questions and procedures for subsequent 
interviews . 

The first interview (September and October) ascertained 
which components had been used and how they had been used. For 
example, the first question was: 

"Have you used any of the pretests?" 

If yes, "Which pretests? Please describe how the 

tests were given, scored and interpreted. How 

were the results used?" 
If no, "When do you think you might use the 

pretests?" 

The second interview (December and January) asked about the 
same components, but addressed not only use but also frequency of 
use. Teachers were requested to suggest changes in components 
that had not been used. For example, the first question was: 

"Are you making regular use of the pretests?" 

If yes, "Please describe how tests are given, scored 

and the results usp.d?" 
If no, "Is there something we can do to make the 

pretests more usable or useful?" 

The third interview (June) asked which components of the 
model were in regular use and why some were discontinued. For 
example, the first question was: 

The pretest assesses the student's skill in the 

following domains: Number Concepts Probltim Solving. 

Did you make use of this test? 

For which domains? Please describe how the tests were 

given, scored and results used. 
Why did you continue/discontinue use of this test? Was 
there something that we could have done to make the 
pretest more useful to you? 

The third interview also included questions of a general 
evaluative nature about the instructional model and computers. 

Comparison semiple 

Each student who had received the instructional model in an 
experimental school was matched with a special education student 
in one of the comparison schools, students in the one 
experimental magnet school were matched with comparison students 
in three comparison magnet schools, and students in the two 
experimental nonmagnet schools were matched with comparison 
students in six comparison nonmagnet schools. Matching was done 
on the basis of the following variables obtained from the school 
district's special education database: sex, race, level of 

4 



7 



service, category of handicap, grade, special education grade and 
age (within six months) . 

This study had certain limitations associatr.d with quasi- 
experimental designs. Although a rigorous matching procedure was 
employed, the comparability of experimental and comparison groups 
can not be assumed with the confidence that would have been 
possible with random assignment of subjects to groups. Also, the 
nature of the comparison condition was not controlled or 
documented. 

Posttest 

In May and June, posttests and attitude tests we:re 
administered in the three experimental schools and nine 
comparison schools. See Appendix C for copies of tests. The 
posttest was a criterion-referenced test on three of the seven 
domains of the Maryland Functional Math Test — whole numbers, 
mixed numbers, and decimals. The other domains were excluded 
because students in the experimental schools spent negligible 
amounts of computer time on these areas. The posttest was 
divided into two parts with 24 and 28 items respectively. Test 
items were selected from a practice test developed previously by 
the school district, with additional items on prerequisite 
fraction skills. With the exception of the items on whole number 
addition and subtraction, a multiple choics format similar to the 
Maryland Functional Math Test was used. 

Reliability analysis was conducted on the overall posttest 
and on the items in each of the domains (see Appendix D) . The 
overall reliability coefficient (Cronbach's alpha) was .93, and 
the coefficients for whole numbers, decimals and mixed numbers 
were .85, .70 and .88 respectively. 

To measure student attitudes toward math, the Survey of 
School Attitudes— Intermediate Form A (Hogan, 1975) was adapted 
to include only 15 items on math and five distractor items on 
other topics. The reliability coefficient on the 15 math 
attitude items was .83 (see Appendix D) . 

Test administration . Project staff members administered the 
posttest in the schools on two consecutive days (with later 
makeups scheduled as needed) . On the first day, students 
completed the attitude test and part one of the posttest. On the 
second day, students completed part two of the posttest. Test 
administrators delivered a standard set of test directions and 
were instructed to remove obvious aids (e.g. multiplication 
charts) from display in the room. 

9th-Grade Maryland Functional Mathematics Test 



The Maryland Functional Mathematics Test is administered 



statewide to 9th-grade students, giving them their first 
opportunity to fulfill the minimal competency graduation 
requirement in mathematics. During the school year following our 
study, a follow-up study was conducted of the 8th-grade students 
who had been included in our posttest analysis and who had 
subsequently taken the 9th-grade Maryland Functional Mathematics 
Test. The purpose of this follow-up study was to determine the 
long-term effects of the model. 

RESULTS OF THE COMPARISON STUDY 

Subject Characteristics 

Experimental subjects were eliminated from the analysis if 
(a) they left the experimental school prior to posttesting, (b) 
they were not perfectly matched with a comparison student, or (c) 
they or their matched student failed to complete the posttesting 
procedures. After these criteria were applied, a total of 136 
subjects, 68 in each condition, remained for the analysis. 
Tables 1 and 2 display characteristics of these subjects. 



Table 1 

Average Age and Score on the 7th-Grade Practice MFMT 
for Experimental and Comparison Subjects 

Average Age Average Score on 

(in months) 7th-grade MFMT 

Mean Std Dev Mean Std Dev 

Experimental Subjects 164.6 9.4 237.2 16.3 

Comparison Subjects 164.3 8.8 287.7 18.5 

Entire Population 164.5 9.1 287.4 17.4 
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Table 2 

Numbers of Matched Pairs of Experimental and 
Comparison Students by Grade, Level of Service, 
Handicapping Condition, Sex and Race 

Number of Pairs Percent 



*Grade 
7 
8 



36 
32 



53% 
47% 



Level of Service 
2 
3 
4 



5 
38 
25 



7% 
56% 
37% 



Category 

Speech/Lang.. Impaired 
Specific Learning Dis 



1 
67 



1% 
99% 



Sex 
Male 
Female 



46 
22 



68% 
32% 



Race 
Black 
White 



60 
8 



88% 
12% 



* The term "grade" here and in the remaining analysis refers 
to the "special education grade" as recorded by the school 
system. 



Table 3 compares the composition of the experimental sample 
■yifh the special education populations of the experimental 
o^^nools and the school district. The male/female percentages in 
*-KLtd sample appf ar to mirror the district special education 
population. However, the percentage of Black and learning 
disabled students is higher in the sample than in the 
^experimental schools or the district. T>^is deviation in 
percentages may have resulted from the s-t^ecific classrooms and 
programs selected for the study. Also, the rigorous matching 
procedure used to identify comparison subjects may have amplified 
disproportionalities occurring in the population (i.e. finding 
satisfactory matches may have been increasingly difficult for 
smaller segments of the population). In any case, in 
generalizing the findings of this study, one should consider that 
the proportion of learning disabled and Black students in our 
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sample was higher than in the special education population of the 
school district. 



Table 3 

Comparison of Sample with Special Education Populations 
in the District and the Experimental Schools 

District Experimental Experimentcil 

Schools Sample 



Male 
Female 



67% 
33% 



64% 
36% 



68% 
32% 



Black 
White 
Other 

(American Indian, 
Asian and Hispanic) 



67% 
30% 



76% 
22% 
2% 



88% 
12% 

0% 



Specific Learning Dis, 
Speech/Lang. Impaired 
Other Handicaps 



56% 
24% 
20% 



76% 
2% 
22% 



99% 
1% 
0% 



Computer Experiences 

The 68 experimental subjects received a mean of 1.6 (SD = 
.63) computer sessions per week, ranging from an individual 
average of .5 sessions to 2.8 sessions per week. These subjects 
spent a mean of 1189.6 (SD = 659.7) total minutes at the 
computer, which averaged to approximately 4 9.6 minutes per week. 
The predominant use of computer time was on three domain areas: 
whole numbers, mixed numbers and decimals. These data are 
displayed on Tables 4 and 5. 



Table 4 

Time and Sessions on Computer 



Variable 



Mean 



Std Dev Minimum Maximum 



Minutes on Computer 1189.6 659.7 180.0 2895.0 

Average Minutes per Week 49.5 27.5 7.5 120.6 

Total Sessions 37.6 15.1 11.0 68.0 

Average Sessions per Week 1.6 .6 .5 2.8 
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Table 5 
Time Spent on MFMT Topics 
(in minutes) 



Variable 



Mean 



Std Dev 



Minimum Maximum 



Number Concepts 
Whole Numbers 
Mixed Numbers 
Decimals 
Measurement 
Using Data 
Problem Solving 
Other 



39.2 
589.1 
261.6 
200.2 



4.4 
1.1 
93.2 
.8 



112 .8 
542.3 
390. 1 
208.7 
13.0 



3.9 
209. 3 
4.9 



0.0 
90. 0 
0.0 
0.0 
0.0 
0.0 
0.0 
0.0 



525. 0 
1940 . 0 
1320.0 
1100 . 0 



45.0 
15. 0 
835.0 
35 . 0 



Posttest Performance 



The mean posttest score for the entire group was 26.7 (SD = 
10.5), or 51.4% of the 52 possible points. The question of 
primary interest — the effect of the instructional model on 
posttest performance — was tested by means of an analysis of 
variance on posttest scores. Other factors — grade level, level 
of service, sex and race — were also included in the analysis. 
One issue of possible interest — the effect of category of 
handicap — was excluded from the analysis because all but two of 
the subjects were classified as learning disabled. 

Although the procedure of matching subjects functioned 
effectively to generate similar groups, the correlation between 
matched subjects' posttest scores was found to be nonsignificant 
(r (66) = .02, p = .86). Therefore, the subject pairings were 
not used in the analysis of the posttest scores. 

On some analyses, the student's score on the 7th-grade 
practice administration of the Maryland Functional Math Test was 
used as a covariate to control for prior ability. This score was 
found to be highly correlated with the posttest score (r (110) = 
.63, p < .001). However, several factors limited the usefulness 
of this covariate. First, 24 students (17.6% of the sample) did 
not have recorded scores on this practice Maryland Functional 
Mathematics Test. Also, the absence of the covariate was found 
to be significantly related to the level of service (Chi-Square 
(2) = 22.67. p < .001), with 38% of the level 4 students missing 
this score, as compared with 10% and 5% respectively for the 
level 2 and 3 students. Finally, the homogeneity of regression 
assumption was not met for several of the variables involved in 
the analysis, and violating this assumption may distort the 
results of analysis of covariance. Thus, while the results of 
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the analysis of covariance are reported at several points in the 
following discussion, the preceding limitations regarding the use 
of the covariate should be recognized. 



Table 6 

Analysis of Variance on Posttest Score 





Sum of 




Mean 






Factor 


Squares 


DF 


Square 


F 


P 


Main Effects 












Condition 


16.9 


1 


16.9 


. 2 


.69 


Grade Level 


461. 8 


1 


46: .8 


4.4 


. 04 


Level of Service 


609 .8 


2 


304 . 9 


2.9 


. 06 


Sex 


153 .4 


1 


153.4 


1.5 


.23 


Race 


0.5 


1 


0.5 


. 0 


.95 


Residual 


13602.2 


129 


105.4 







Table 6 displays the results of an analysis of variance cn 
posttest score. In this analysis, the posttest was found to be 
significantly affected by grade level. With the inclusion of the 
covariate, the effects of level of service (F(2,104) =6.0, p < 
.01) and sex (F(l,104) = 3.8, p = .05) became significant. Means 
and standard deviations for the levels of the factors are 
displayed in Table 7. The factor of primary interest — the 
instructional model — had no significant main effect upon posttest 
performance with or without the covariate. 
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Table 7 

Means and Standard Deviations on Posttest 





Factor 


Level 


Mean 


SD 


Cases 




Condition 


Exper . 


27 . 0 


10. 7 


68 






Compar . 


26.3 


10.4 


68 


* 


Grade Level 


7 


24 .8 


10. 1 


72 






8 


28.8 


10 . 7 


64 




Level of Service 2 


28.4 


11. 9 


10 






3 


28.5 


9.5 


76 






4 


23 . 6 


11.2 


50 




Sex 


Male 


26.1 


10.3 


92 






Female 


27.9 


10. 9 


44 




Race 


Black 


26.6 


10.4 


120 






White 


27.4 


11. 6 


16 



* statistically significant difference without covariate 
** Statistically significant difference with covariate 



To eliminate empty cells and allow interactions to be 
analyzed, the dat?. set was modified as follows. Level of service 
was collapsed by combining levels 2 and 3, thus creating a factor 
with two possible values — level 2/3 and level 4. Also, race was 
dropped from the analysis due to the small number of subjects in 
one subgroup. An initial analysis revealed that no three- or 
four-way interactions were significant, and the analysis was 
repeated with these higher order interactions suppressed. The 
results are displayed in Table 8. 
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Table 8 

Main Effects and Two-Variable 
Interactions on Posttest Score 





bUIU OL 












Factor 


Squares 




DF 


Square 


F 


P 


Main Effects 














Condition 


16.9 




1 


16.9 


. 2 


. 68 


Grade Level 


464.7 




1 


464 . 7 


4.8 


. 03 


Level of Service 


637 .6 




1 


637 .6 


6.5 


. 01 


Sex 


154.2 




1 


154 .2 


1.6 


.21 


2-way Interactions 














Condition by. . . 












<. 01 


. . .Grade Level 


1106. 


4 


1 


1106.4 


11.3 


...Level of Service 


1. 


5 


1 


1 . 5 


0.0 


. 90 


. . . Sex 


18. 


7 


1 


18.7 


. 2 


.66 


Grade Level by. . . 












.32 


...Level of Service 


97. 


2 


1 


97 .2 


1.0 


• • • S ex 


27. 


2 


1 


27 . 2 


. 3 


. 60 


Level of Service by.. 


• 










. 16 


• • • Sex 


194. 


5 


1 


194 . 5 


2 . 0 


Residual 


12202. 


9 


125 


97. 6 







This analyses revealed a strong interaction between grade 
level and condition. The nature of this interaction can be seen 
in the subgroup means displayed on Table 9. At the 8th grade 
level, the experimental group was significantly higher than the 
comparison group (F(l,62) = 6.9 p = .01). At the 7th grade 
level, the comparison group was significantly higher than the 
experimental group (F (1,70) = 4.0 p = .05). 
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Table 9 
Mean Posttest Scores by 
Condition and Grade Level 



Grade Level: 




7th 


8 th 


Experimental 


mean 


22 . 5 


32. 1 




SD 


8.3 


10.9 




number 


36 


32 


Comparison 


mean 


27.2 


25.4 




SD 


11.3 


9.5 




number 


36 


32 



Tables 10, 11 and 12 display means for the three types of 
problems on the posttest. Overall, the students averaged 10.3 
(SD =4.0) on whole number operations, 8.6 (SD = 5.1) on mixed 
number operations, and 7.8 (SD =2.9) on decimal operations. All 
three types of problems showed the same pattern of interaction 
noted on the overall posttest score — the experimental group 
higher than the comparison group at the 8th grade level but the 
reverse at the 7th grade level. Thus, it does not appear that 
the overall posttest interaction arose from differential means 
among the various types of problems. 



Table 10 
Mean Posttest Scores on 
Whole Number Operations 
by Condition and Grade Level 



Grade Level 


: 7th 


8 th 


Experimental mean 


8.8 


12 . 1 


SD 


3.7 


3.5 


number 


36 


32 


Comparison mean 


10.3 


10.0 


SD 


4 . 2 


4.2 


number 


36 


32 
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Table 11 
Mean Posttest Scores on 
Mixed Number Operations 
by Condition and Grade Level 



Grade Level: 7th 8th 

Experimental mean 7.0 10.8 

SD 4.1 5.9 

number 3 6 32 

Comparison mean 9.2 7.5 

SD 5.4 4.3 

number 3 6 32 



Table 12 
Mean Posttest Scores on 
Decimal Operations 
by ConditiDH and Grade Level 



Grade Level: 7th 8th 

Experimental mean 6.7 9.2 

SD 2.6 3.0 

number 3 6 32. 

Comparison mean 7.6 7.8 

SD 2.9 2.5 

number 36 32 



Interaction Between Condition and Grade 
Level on Posttest Performance 

The following analyses explored the interaction between 
condition and grade level on posttest performance. These 
analyses were intended to determine if the effect was spurious 
(e.g. resulting from prior differences between subject groups or 
from other uncontrolled variables) , or if certain aspects of the 
intervention could be identified as contributing to the effect. 

Preexisting differences between cfroups . To determine if 
preexisting differences in subject groups contributed to the 
interaction between condition and grade level, analysis was 
conducted of the scores on the 7th-grade practice Maryland 
Functional Math Test (which preceded our intervention and was 
highly correlated with the posttest) . Table 13 displays mean 
scores on this test broken down by grade level and condition. No 
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significant affects were found for grade level (F (1,108) = .52, p 
= .48) or condition (F(l,108) = .02, p « .89) or for the 
interaction between grade level and condition (F( 1,108) = .03, p 
= .87). Also, Chi-square analyses revealed that the two grade 
levels did not differ significantly in composition by level of 
service (Chi-square (2) = 1.9, p = .38), sex (Chi-square (1) = 
2.4, p = .12), or race (Chi-square (1) =0.3, p = .58). 



Table 13 

Mean 7th-Grade Practice MFMT Scores 
by Condition and Grade Level 



Grade Level : 




7 th 


8th 


Experimental 


mean 


285.8 


288.7 




SD 


16.4 


16.5 




number 


28 


26 


Comparison 


mean 


286. 8 


288.6 




SD 


20.6 


16.3 




number 


30 


28 



School effects . Posttest means for individual schools were 
analyzed to determine if posttest scores differed significantly 
from school to school and to study the nature of the distribution 
of scores across schools. Table 14 displays means of the 
posttest performance by school, grade level and condition. 
Analyses of variance suggested that in all cells but the 7th 
grade experimental schools, the school factor had a significant 
or nearly significant effect on posttest performance. 
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Table 14 
Posttest Means Broken Down by 
School and Condition 



Experimental Schools 

7th Grade 8th Grade 



School 




Posttest 


Number 


Posttest 


Number 






Mean 


SD 


of Cases 




Mean 


SD of 


Cases 
















School 


1 


21.4 


9.1 


8 


23.3 


10.8 


6 


School 


2 


23.3 


10. 0 


16 


34 .5 


7.4 


10 


School 


3 


22. 3 


5.5 


12 


33.9 


11.6 


16 






F(2,33) 


= 0. 1 p = 


.88 


F(2,29) 


= 2.7 


p = .09 


Comparison 


Schools 


















7th Grade 






8th 


Via H A 


School 




Posttest 


Number 


Posttest 


Number 






Mean 


SD 


of Cases 




Mean 


bU OI 


Cases 
















School 


4 


25.7 


12. 1 


3 


29.2 


4.8 


5 


School 


5 


15. 5 


3.5 


2 


31.0 


0.0 


1 


School 


6 


29. 0 


10.3 


5 


19.0 


11 . 1 


5 


School 


7 


26.0 


9 . 9 


2 


37.0 


0.0 


1 


School 


8 


12 .7 


6.5 


3 


14 . 0 


0.0 


1 


School 


9 


27.5 


6.2 


6 


21.1 


8.0 


9 


School 


10 


34 . 5 


13.4 


2 


39.5 


10.6 


2 


School 


11 


20.8 


9.2 


6 


29.0 


8.4 


6 


School 


12 


39.4 


8.1 


7 


23 . 5 


0.7 


2 






r(a,27) 


= 3 .7 p < 


.01 


F(8,23) 


= 2.2 


p = .06 



Since the factor of individual schools tended to influence 
posttest performance, this factor was analyzed further to 
determine if the inclusion of specific schools, particularly in 
the comparison group, had an extreme effect on mean posttest 
scores. Figure 2 displays histograms of posttest means for 
experimental ([E]) and comparison ([C]) schools at the 7th and 
8th grade levels. The numbers in the brackets are the number of 
student scores represented at each school and grade level. 
Because of the smaller numbers of students at each of the 
comparison schools, the means for these schools at both grade 
levels were distributed more widely than for the experimental 
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schools. 



One comparison school (School 12 in Table 14) had a 
relatively large number of 7th-grade students (7) with a high 
mean posttest score (39.4) and thus contributed substantially to 
the high cell mean. The 7th-grade comparison subjects at this 
school scored significantly higher on the posttest than the 
remaining 7th-grade comparison subjects (t (27) = 4.1, p <.001). 
When the 7th-grade students at this school and their matched 
experimental subjects were excluded from analysis, the condition 
by grade level interaction remained significant (F (1,121) = 5.3, 
p = .02), but the difference in posttest means for the 7th-grade 
experimental and comparison groups was decreased (22.7 and 24.2, 
respectively) and was no longer significant (F (1,57) = .37, p = 
.55) . 

In summary, the interaction between condition and grade 
level could not be explained by any identifiable prior 
differences in student abilities or group compositions. The 
apparent superiority of the 7th-grade comparison group was 
eliminated upon the removal of one comparison school and its 
matched experimental subjects. However, the overall interaction 
of condition by grade level remained significant. 
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Figure 2 

Histograms of Mean Posttest Scores 
by School, Grade Level end Condition 
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Factors contributing to the interaction . Since the 
interaction between grade level and condition could not be 
dismissed as spurious, the analysis turned to specific aspects of 
the intervention which might have contributed to the interaction. 
The computer experiences of 7th and 8th grade students did not 
differ significantly in mean number of computer sessions per weeK 
or on total time on computers (see Table 15). However, when time 
spent on specific domain topics was analyzed, significant 
differences were found in the amount of time spent on whole 
numbers and on mixed numbers. As a group, 7th graders spent 
significantly more time on whole number operations and number 
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concepts and significantly less time on mixed number operations 
than did 8th graders. 



Table 15 

Comparison of 7th and 8th Grade Experimental Subjects 

7th Grade 8th Grade F- 

mean SD mean SD stat p 

Computer Sessions 1.5 0.6 1.7 0.6 1.5 .23 
per Week 

Total Time on 1166.0 606.1 1216.1 724.2 1.0 .76 
Computer 

Time on Number 819.3 628.8 413.4 333.1 10.7 <.01 
Concepts and 
Whole Numbers 

Time on Mixed 117.2 193.0 424.1 485.1 12.2 <.01 
Numbers 

Time on Decimals 164.7 228.2 240.0 179.7 2.2 .14 



Time on Measurement 64.7 84.3 136.9 298.3 1.9 .17 
Using Data and 
Problem Solving 



Correlations were calculated between computer experience 
variables and posttest performance. To reduce the effects of 
prior abilities, three factors were partialled out — level of 
service, score on the 7th-grade practice Maryland Functional Math 
Test, and grade level. Together, these had a multiple R of .65, 
and thus accounted for 42% of the variance in posttest 
performance. Table 16 displays partial correlations between the 
remaining variables and posttest performance. The amount of 
computer time spent on the most basic skills — number concepts and 
whole numbers — had a significant negative partial correlation 
with posttest performance; while the amount of time spent on a 
more complex skill — mixed numbers — had a significant positive 
partial correlation. The amounts of computer time rpent on 
decimals, measurement, using data and problem solving were not 
significantly related to posttest performance. 



ERIC 



19 

22 



Table 16 
Partial Correlations Between 
Intervention Variables and Posttest Score 





Partial 


T- 




Variable 


correia uion 




p 


Total Time on Computer 


-.07 


-.6 


.57 


Total Sessions on Computer 


.00 


.0 


.97 


Time on Number Concepts 


-.30 


-2.5 


. 02 


and Whole Numbers 








Time on Mixed Numbers 


.39 


3.3 


.00 


Time on Decimals 


-.07 


-.5 


.61 


Time on Measurement, Using 


-.12 


-.9 


.36 



Data and Problem Solving 



Causality cannot be inferred from these statistics. 
However, it may be noted that the two topics upon which 7th and 
8th grades differed significantly in computer time also had 
significant partial correlations with posttest performance. The 
7th graders spent significantly more time on the topic that was 
negatively correlated with performance and significantly less 
time on the topic that was positively correlated with 
performance. 

Attitude Test Results 

The students scored an average of 21.0 (SD = 5.9J on the 
attitude test. This score was not significantly affected by any 
of the factors under consideration except sex (F (1,134) = 5.1 p 
= .03) (see Table 17). It was not significantly correlated with 
the score on the 7th-grade practice Maryland Functional Math Test 
(r (110) = .03, p = .39) or the posttest score (r (134) = .07, p 
= .39). For the experimental group, the attitude test score was 
not significantly correlated with sessions on the computer (r 
(66) = .07, p = .30), time on the computer (r (66) = .00, p = 
.48), or time on any of the topics. The observed posttest 
interaction between condition and grade level was not mirrored in 
the attitude test. The interaction between condition and^grade 
level on the attitude test was nonsignificant (F (1,132) = .87 p 
= . 35) . 
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Table 17 

Means and Standard Deviations on Attitude Test 



Factor 


Level 


Mean 


SD 


Cases 


Condition 


Exper. 


21.3 


5.9 


68 




Compar . 


20. 7 


6.0 


68 


Grade Level 


7 


20.6 


5.8 


72 




8 


21.5 


6.1 


64 


Level of Service 2 


22 . 2 


6.9 


10 




3 


20.8 


5.8 


76 




4 


21.2 


6.1 


50 


*Sex 


Male 


21.8 


5.9 


92 




Female 


19.4 


5.9 


44 


Race 


Black 


21.3 


6.0 


120 




White 


19. 1 


5.1 


16 



* statistically significant difference 



Results of 9th-Graae Maryland Functional Mathematics Test 

Of the 64 eighth grade students included in the ijreceding 
analysis, 57 (89.1%) took the 9th-grade administration of the 
Maryland Functional Mathematics Test the following academic year. 
This represented 87.5% of the experimental subjects and 90.6% of 
the comparison subjects. Follow-up analysis was conducted on the 
scores received on this test and on the rate of passing the test 
(i.e. receiving a score of 340 or above). Subjects were excluded 
from this analysis if either they or their matched subject did 
not have a recorded score. This resulted in a sample of 2 6 
experimental and 26 matched comparison subjects. 

Table 18 displays the performance on the 9th-grade Maryland 
Functional Mathematics Test and Table 19 displays the results of 
an analysis of variance on the various factors. 
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Table 18 
Means, Standard Deviations and 
Percent Passing on 9th-Grade MFMT 









Mr Mi 




Da v*/^ am ^ 

jrercen u 


Factor 


Level 


Cases 


Mean 


SD 


Passing 


Condition 


Experimental 


26 


324 . 3 


22.2 


27% 




Comparison 


26 


313. 1 


18. 8 


12% 


Level of 


2 and 3 


34 


323 . 1 


19.9 


24% 


Service 


4 


18 


310.4 


21.4 


11% 


Sex 


Male 


36 


319 . 8 


20.4 


22% 




Female 


16 


316.2 


23. 1 


13% 


Race 


Black 


46 


316.9 


19.7 


15% 




White 


6 


332 .7 


28 . 3 


50% 



Table 19 

Analysis of Variance on 9th-Grade MFMT 



Sum of Mean 



Factor 


Squares 


DF 


Square 


F 


P 


Main Effects 












Condition 


1628. 5 


1 


1628.5 


4.3 


. 05 


Level of Service 


1867. 3 


1 


1867.3 


4.9 


. 03 


Sex 


3.2 


1 


3.2 


0.0 


.93 


Race 


1185.8 


1 


1185. 8 


3.1 


.09 


Residual 


17973. 8 


47 


382.4 







A log-linear analysis was conducted on the rate of passing 
the 9th-grade Maryland Functional Mathematics Test as a function 
of condition, level of service, sex and race. This method of 
analysis was selected because it is appropriate for categcprical 
data and permits simultaneous analysis of a number of variables. 
The results are summarized in Table 20. Since no significant 
effects were observed for interactions of more than two 
variables, Tabl'^ 20 includes only single-variable and two- 
variable associations with rate of passing the test. The 
interaction between race and condition should be interpreted with 
caution because of the small number of white students included. 
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Table 2 0 
Partial Associations with 
Rate of Passing 9th-Grade MFMT 



Effect with Rate 




Partial 




of Passing MFMT: 


DF 


Chi-Square 


p 


Condition 


1 


2.270 


. 13 


Sex 


1 


. 125 


.72 


Race 


1 


3.048 


. 08 


Level of Service 


1 


1. 342 


.25 


Condition by Sex 


1 


.000 


1. 00 


Condition by Race 


1 


4 .919 


. 03 


Sex by Race 


1 


. 000 


1. 00 


Condition by Level of Service 


1 


1.252 


.26 


Sex by Level of Service 


1 


.825 


.36 


Race by Level of Service 


1 


. 002 


.97 



RSSULTS OF THE STRUCTURED INTERVIEWS 

A total of seventeen teachers were interviewed. Teacher 
responses to components of the model were compiled across the 
interviews and judged by the project staff as indicating that the 
teacher (a) used the component, (b) did not use the component, or 
(c) that degree of use could not be accurately determined. 
Following are summaries of these findings. Appendix E contains a 
complete report of teacher responses with teachers designated by 
the letters "A" through "Q" to maintain anonymity. 

Teacher Use of the Components of the Model 

Pretest/Posttests : 

Used = 13 Did Not Use = 2 Undetermined = 2 

Thirteen teachers reported using the pretests/posttests . 
Two did not use them at all. Two teachers were not clear in 
their report of using them. 

The pretests tended to be used in ways not intended by the 
designers, and only two teachers, "E" and "K", used the pretests 
specifically as designed. Teachers "F", "I" and "Q" used the 
tests as a baseline or an assessment to help with instructional 
planning. "C" used the pretests/posttests to have her students 
compare their progress and see if they had made any of the same 
errors. 

Four teachers, "B", "K", "N", and "P" discontinued use of 
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thefse tests after a few uses, for a variety of reasons. And two, 
"J" and "L", reported that they did not use these tests at all. 
••L" said she already knew what domains and objectives to work on, 
and "J" didn't work with any component of the model except the 
software. 

Diagnostic Evaluations: 

Used = 11 Did Not Use = 4 Undetermined = 2 

The diagnostic evaluation was designed to reveal student 
weaknesses in specific skill areas. Eleven teachers said they 
used the diagnostic evaluations, but similar to the pretests not 
all of them were given as they were intended to be used. Teacher 
"C" used them as warm-ups and worksheets, while teacher "M" used 
them as teaching tools foi presenting material that was not yet 
covered by her stidents. "Q" used them midyear to prepare her 
students for the California Achievement Tests. "P" used them as 
they were intended, and to put students into groups for computer 
work and finally, "D" used these tests as a baseline at the 
Deginning of a unit and again as a posttest to compare results 
after teaching the material. 

Four teachers did not use these evaluations. "H" gave them 
to his students because they were copied for him by someone but 
he did not use the results. Teachers "K" and "L" used them early 
on but then discontinued. Teacher "L" commented on her large 
class size and how difficult it was for her to individualize 
instruction. Both of these teachers went directly to the 
matrices for software selection, skipping the diagnostic process. 
Based on the comments from teachers "A" and "B" it was difficult 
to determine whether they used the diagnostic evaluations or not. 



Domain Directory: 

Used = 9 Did Not Use = 8 Undetermined = 0 

Nine teachers reported use of this directory for assistance 
with their teaching. For example, teachers "E" and "O" used it 
mainly for the suggested teaching strategies, while "A", C and 
"M" reported using the directory predominantly for the 
vocabulary. In fact, teacher "M" sent this list home to parents 
for extra reinforcement of the words. "P" and "Q" used the 
directory for help when working on specific skills with a 
specific group of students. 

Eight teachers did not use the domain directory on a regular 
basis. Teachers "K" and "L" thumbed through it once or twice 
early in the year to become acquainted with the pro:]ect. G 
commented that she liked the way it was organized, but she felt 
no netd for it. And finally teachers "F" and "H" never looked at 
the directory. 
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Matrix: 



Used = 9 Did Not Use = 8 Undetermined = 0 

The matrices were apparently very helpful to teachers "M" 
and "N" who used them regularly to identify software activities 
that correlated to specific skills. "M" commented that she 
enjoyed putting the students on different disks and her students 
enjoyed the /ariety of software, especially doing something 
different than what their neighbor was doing. Teacher "0" 
duplicated them and put them in her planbook for a quick 
reference to the software that was available for the skills she 
was covering in class. 

Several of the teachers from one school reported that they 
didn't use the matrices themselves, but the computer director 
used them regularly for selecting their classes' software. They 
gave him examples of the material that their students were 
working on or the results of the diagnostic evaluations and he 
consulted the matrices for software selection. "E" helped other 
teachers to understand how to use the matrices, but she had the 
computer aide select most of her software. 

"I", "K" and "L" all discontinued using the matrices by 
midyear because much of the software identified for the skills 
did not run on the Apple 11+ . "K" said this was too frustrating, 
and instead went to the box of software and read the software 
summaries to help review the programs. 

Software Summaries: 

Used = 11 Did Not Use = 6 Undetermined = 0 

All of the teachers who used the summaries expressed 
satisfaction with the information that they included. Teachers 
"A" and "B" said reading the summaries helped them to better 
explain how to use the software programs to their students and 
this in turn helped tba students catch on more quickly. "B" was 
particularly impressed with the Teacher Options section because 
it was easier to read about the options offered on a program 
rather then "playing around" with it. "F" began reading the 
summaries by the second half of the school year. She said that 
reading them was quicker than reviewing the software manually. 
Two teachers "K" and "L", who earlier reported that they did not 
use the matrices, frequently used the summaries for the software 
review and the correlation to skills. 



Skill Sheets: 



Used = 13 Did Not Use = 4 Undetermined = 0 

The Skill Sheets were intended to be used as quick paper and 
pencil assessments following computer practice. Teachers "C", 
"E" and "K" used them in this way. "P" said she used the Skill 
Sheets on every third visit to the computer lab as a quick post 
computer assessment "to see if there was a screen to paper 
transition." Teachers "B" and "D" used them in class before 
going to the computer lab. 

Most of the teachers reported u? i.nq the Skill Sheets for 
classwork, homework, warm-ups and quizzes. Teacher "H" said he 
"used the heck out of them" but mostly as work sheets. He often 
added more problems to the back of a page. "M" used them to 
teach from in class when a student was ^ wing a problem with a 
skill. 

Teacher "G" said she did not use them because they were not 
challenging enough for her students. "N" also did not use them 
because the courseware series that he used, provided work sheets 
that directly matched the software. 

Software: 

Used = 17 Did Not Use = 0 Undetermined = 0 

Every teacher in the project used software that was provided 
with the materials. The most popular software program was 
Conquering Whole Numbers by MECC, which was used by twelve of the 
seventeen teachers. 

Other popular programs were: 

Speedway Math - 7 
Milliken - 6 

Multiplication Puzzles - 6 
Number Munchers - 4 
Fraction Munchers - 3 
Clockworks - 1 
Arithmetic Critters - 2 
Subtraction Puzzles - 1 
The Market Place - 2 
Mindscape - 2 
Decimal Concepts - 2 
Fraction Concepts - 1 

Miscellaneous Materials: 

Used = 1 Did Not Lse = 17 Undetermined = 0 
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The miscellaneous materials were a compilation of worksheets 
gathered from several counties and organized by domain in a 
portable file box. They were included with the math materials 
for supplementary use. Only one teacher reported using these 
materials, and even he commented that he did so because he 
thought he had to as a participant in the study. 

General Evaluative Responses 

The final teacher interview included five questions on the 
general impact of the instructional model upon the teachers and 
students. 

Question 1: What changes have occurred in your method and 

approaches toward teaching math, since becoming part 
of the Middle School Math Project? 

Analysis of the responses revealed that two different types 
of changas occurred. In some cases,, the changes reflected a 
process of simply fitting the computer and other elements of the 
model into the teachers' instruction. Since the participating 
teachers were expected to make this type of change, these 
responses are not discussed further. 

The second type of change reflected a more generalized 
change xn teaching as a result of the experience with the model. 
Five of the sixteen teachers reported this second type of change. 
Several of them reported that they individualized their 
instruction more. For example, Teacher "M" reported that as a 
result of the training provided by this project, her overall 
teaching of math improved. "I individualize more and have become 
more aware of specific skills and concepts that kids lack and the 
way kids process information." Teacher "P" stated that she was 
more "analytical" as a result of the project due to the task 
analysis component of the model. She said, "The computers 
helped me to see exactly where the students were having a problem 
because of the immediate feedback [of the software]. During 
classwork paper and pencil tasks, teachers will often miss the 
errors. " 

Teachers also reported changes in their use of computers. 
Teacher "D" said she became more "aware" of the fact that she can 
use the computer room for "practical application and math 
practice," while another said she uses the computer for 
"remediation . " 

Question 2: Have the students benefitted from this project? Do 

you think they learned more? 

Each of the sixteen teachers interviewed indicated that 
their students' benefitted from this project. Five stated that 
their students' learned more and three i-f-:*chers noted specific 
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skill improvements such as counting and multiplication facts. 
Teacher "A" said: "[Student Name] could not count and now he can 
count and tell time from using Clockworks, (by MECC)." Teacher 
"B" told us, "Their math has improved and they have been forced 
by using the computer, to memorize their multiplication facts." 
Teacher "0" said she had seen a marked improvement on the math 
portion of the Woodcock Johnson Test. 

Two teachers indicated their students didn't "learn more." 
Teacher "N" stated that his students probably didn't learn more 
because of prior exposure to this kind of information, but he was 
certain that they "retained" more. Teacher "M" said, "They are 
not as afraid to learn new thivigs because they are not afraid of 
making mistakes. Therefore there is less fear in learning new 
concepts . " 

Five teachers mentioned an increase in their students' 
motivation to do math. Teacher "P" stated, "Students are much 
more motivated to get it right when problems are presented on the 
computer, it must be something about them being up on the screen 
verses paper and pencil." Teacher "C" stated, "Most kids enjoy 
math or want to enjoy it, and they do enjoy it with the 
computer." Teacher "K" commented that the math teacher with whom 
he works noticed an increase in student attendance on the days 
they were scheduled to go to the computer lab. 

Question 3: Rate your level of comfort (on a scale of 1 = very 

uncomfortable to 5 = very comfortable) with using 
computers in teaching before becoming a part of the 
Middle School Math Project and what changes have 
occurred in your attitudes and approaches toward 
using computers, since becoming part of Project? 

Eight of the sixteen teachers gave themselves pre-project 
ratings below a comfort level of three. Each of these said their 
level of comfort has increased greatly. 

Five teachers gave themselves pre-project ratings of three. 
Of these, all said they have increased either their positive 
attitude or their awareness of the usefulness of computers as a 
teaching tool. 

As a result of their contact with the math project, eight of 
the teachers reported overcoming an initial reluctance regarding 
computer use and/or an interest in integrating computers into 
other content areas. 

Question 4 In the coming school year, how do you perceive 

yourself using computers and the Instructional Model 
without the requirement of data collection and a 
'three times a week' minimvim of computer time for 
students? 
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The responses indicated that all the teachers plan to use 
the computers and the instructional model in much the same way as 
this year and/or expand the use of the computers to other content 
areas. 

Nine teachers viewed themselves as continuing computer use 
consistent with this year's requirements, three times a week for 
twenty minutes at a time. Two said they would like to make the 
instructional model their math curriculum for next year and four 
more mentioned they would like to use computers in other content 
areas such as English and Reading. Teacher "E" expressed a 
desire to have her students begin using computers for word 
processing . 

Another four teachers mentioned that they would like to use 
computers next year, but are subject to certain conditions such 
as computer lab schedule, magnet program schedule, and 
re-arrangement of class size (for smaller groups) . 

Question 5 Name one positive event that has happened since the 

implementation of this model in your school. 

Six teachers said that their students were more motivated to 
perform well when they were scheduled to work in the computer 
lab. Teacher "J" had a student from another country who had 
undeveloped skills in math, "he was excited and motivated to 
learn on the computer." Teacher "D" said, "The students have 
become more interested in math, they look forward to using the 
computers." Teacher "P" said, "The kids have a "hands on' 
[approach] to math and it is exciting and enjoyable for them." 
Teacher "H" said that his students were "more enthusiastic on lab 
days, than when they are in the classroom." 

Three of the teachers said their students' skills have 
actually increased. Teacher "B" said, "The students have gained 
in self confidence and their math knowledge has increased." 
Teacher "L" said, "The kids are processing information better, 
their skills have improved." 

Two of the teachers reported a change in their students 
perceptions of the computer from a mc.(-..'um for fun and games to a 
medium used for work and learning. For example. Teacher "A" 
overheard a student tell someone that, "We come here [the 
computer lab] to learn, not just to play games." Teacher "C" 
noted an increased computer literacy on the part of her students, 
who are beginning to recognize a correlation between skills 
covered on project software and other programs they have used in 
other math classes. 

Teacher "Q" said that her students are more aware of when 
they need help, "Before they didn't even know where they were 
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lacking. Now they say, "I'm having problems with this, can I 
work on the computer and get some practice?" 

Finally, two of the responses indicated a positive impact on 
teacher functioning. For example Teacher "R", who is a computer 
coordinator, mentioned that all the project teachers have become 
more literate, which means all involved have gained. Teacher "N" 
told us that the skill level for each student has become more 
concrete, "At the beginning of the year, when you read student 
records, it is very difficult to determine where they really 
are." He has used the task analysis (component of the model) to 
write skill levels for his students' Individual Education Plans 
(lEP) . 
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Appendix A 

Description of the Components of the Instructional Model 
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Appendix A 

Deicription of the Components of the Instructional Model 

1. Pretest/Posttests 

Multiple choice tests used to measure performance on 
objectives within the MFMT domains. 

MFM.T result?, are usually expressed in the form of an overall 
cccre for the test and numerical scores for each of the seven 
domains. These scores do not reveal information about the 
specific objectives v/ithin each domain. For example, the 
domain score for Whole. Nianbers does not indicate if poor 
performance was ia Addition, Subtraction, Multiplication or 
Idvision. Pre/posttests originally develop°d by Harford 
County were adopted for use in this project as domain 
assessments. These tests allow the teacher to narrow the 
focus of instruction to particular objective(s) within the 
domains. 

2. Diagnostic Evaluations 

Tests used to measure performance on component and 
prereg^aisite skills of the MFMT objectives. 

The project staff c.nd cooperating teachers performed task 

analyses of the objectives of the MFMT. The diagnostic 

evaluations (one per objective) have several test items for 

each of the skills identified in this task analysis. These 

evaluations isolate skill deficiencies, thus giving better 

indications of where instruction should focus. 

For example, on Adding Whole Numbers (an objective within the 
Whole Numbers domain) we identified twelve component or 
prerequisi-^e skills, such as adding two digit numbers without 
regrouping, adding three numbers with two digits and 
regrouping, etc. 

3. Domain Directory 

A teacher-reference document which provides information on the 
skills covered in the Maryland Functional Math Test. 

The Domain Directory is divided according to the seven domains 
of the MFMT. Each domain is further divided into objectives 
which are reviewed according to: content scope, question 
format, a teaching strategy, vocabulary, and students' common 
errors. 

It is suggested that the directory be studied orior to the 
start of instruction on a domain to provide instructional 
ideas and to ensure that the instruction is consistent with 
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the MFMT. 



Software Matrix 

A grid that matches software programs and activiti s to skills 
and objectives. 

The instractional model includes a software matrix for each 
MFMT objective. Each matrix is a grid that lists skills in 
the-, objective and the software products and activities that 
correspond to those skills. The matrices have x's and o's in 
the spaces that have software to skill mtches. An "x" 
represents software that does not run or. the Apple 11+ . A 
blank space indicates that no software has been identified for 
the skill. 

Software summaries 

One or two-page summaries witl.^ valuable information about the 
software programs and activities. 

The software summaries provide easily readable, practical 
information about the instructional software, including screen 
pictures, activity summaries, teacher options and maragement 
suggestions. Step-by-step information ie given on ^^nat is 
expected of the student user and what the user see on the 
screen. The Teacher Options section is a brief description of 
the options available for modifing the software (e.g. 
selecting activities, speed, content, etc.). The Management 
Suggestions section is based on ob^ arvations of the softv^are 
being use in middle school classes. An example of a 
suggestion one might read is: "Turn the game options off until 
■Che student has completed all of the problems". 

Skill Sheets 

Short pape- -I.. id-pencil quizzes that assess achievement of a 
particular skill and thcs degree of transfer from the computer. 

Teachers often have difficuiting monitoring student 
performance on the computer. One of the options we suggest is 
for teachers to test performance with paper-and-pencil 
materials away from the computer. Because of software's 
immediate feedback, sound effects and motivational design, 
skill achieverient ifay be higher on the -.omputer than on paper 
and pencil activities. The skill sheets were der.igned to be 
given to the students after computer work to test mastery of 
the skill and gauge transfer. 



Computer Software 
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Two math courseware series: Microcomputer Workshops by 
Mindscape and Math Sequences by Milliken; and a number of 
specific software programs by MECC. 

The software was selected to correspond to the domains, 
objectives and skills in the instructional model. It was 
primarily in drill-and-practice or instructional game formatji. 
The selected software was included in the software matrices, 
and a software summary was prepared for each item. The two 
courseware series were self:cted to cover a broad range of 
skills in the whole numbers, fractions and decimal domains. 

The Prince George's County Public School System has a site 
license to copy and distribute MECC software to its schools. 
These programs were therefore reviewed and included in the 
instructional model. 

Miscellaneous Materials 

A collection of worksheets and other instructional materials 
gathered from several counties and organized by domain in a 
portable file box. 

The miscellaneous materials were provided for supplementary 
use at the teacher's discretion. Teachers could use some 
materials directly with their students, and refer to other 
materials for teaching ideas. 
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SCHOD. : Witt 
DAY: 







< 


Number of 

NufT. Con 


Mi r.. 


tei: 

Njn 








Number of 
^^NuiT. Con 


Ml nj 
_W» • : . 


t ei: 

NjfT 






1 


Number of 












Number of 
Num Con 




tes,: 

NjfT 








Number of 
^^NufT Cdti 


.w^ :: 


tes : 








Number of 
Num Con 


flinjtes: 
^Wh:-: Njir 








Number of 
Nurr. Con _ 




:te£: 
Narr 


Number of 
Nuir Con 




te= : 
Njr 



co^' 1 ih; ro^". 

AlC'TiE C'jpr::^ will- (r.umt'p: ) 



Alone G^oupe-d with (nufr.ber) 



Njft.ber of ^'.i-jtei: 



IC 15 2C 



3^ 3Z 40 50 wore 



Narr Co-- U :\ K_- »*.i^er Njn De:i»r.als Meo£ Use Data F>-ot- B; 



( 10 



Njr Co' W 



Alo-:e __6- o-iped wit?' (nunt-?- ! 

€^ = 7 ^- l"~ 1^ 2C I'f 3: 3^ -1'" <Z 50 ~tl^'e 

N-r re: :r£:= n=-a£ Us- Dote Ft ot B: '. 



C0^1":£KT5: 
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Name 



Examples: 



Parti 



1. Add: 



5 
+ 5 

I O 



2. Subtract: 



10 
-_5 

5 



A. 10 

C. 1 

D. 0 
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Parti 



1. Add: 



8254 
+ 7603 



3. Subtract: 



8924 
-1082 



2. Add: 



14 

363 
+ 88 



4. Subtract: 



9447 
-5846 



Parti 



5. Multip]}': 



7. Divide: 



38 
x74 



l084 



6. MvQtiply: 



206 
X 53 



8. Divide: 



6^768 



o 
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Parti 



9. Add: 



75.53 
+ 117.91 



A. 193.44 

B. 182.44 

C. 19344 

D. 511.14 



10. Subtract: 



40.70 
- 6.39 



A. 34.31 

B. 47.09 

C. 46.49 

D. 44.41 



11 . Multiply: 



4.6 
X 3.2 



A. 147.2 

B. 16.82 

C. 2.30 

D. 14.72 




1-3 



44 



Parti 
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13. Solve: 

4% of 21 6 = 



A. 
B. 
C. 
D. 



86.4 
8.44 
8.64 
2.58 



14. Simplify: 



1 

6 — 2 



15: Simplify: 



1 
9 




1-4 



4r) 



Parti 




1-5 



Parti 











21. Multiply: 




23. Subtract and simplify: 




86.3 
X 4.71 




- 3\ 


A. 94.93 




A. 6 4 




B. 406.473 




B. 6 2 




C 4Uo.d1 




c. 6! 




D. 4064.73 




D. 6 6 




22. Solve: 




24: Simplify: 




10% of 486 = 




7 ~ 


A. 4.86 




. 1 

A. AO 




B. 4860 




B.5? 




C. 48.6 




c. 5^ 




D. 486 




D. 7fo 





1-6 
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Part 2 



Name ^ 

Examples: 



1. Add: 
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Part 2 



1. Add: 



5763 
+ 78 



3. Subtract: 



4806 
-2485 




4. Subtract: 



6395 
5763 



2-1 




4!) 



Part 2 



5. Multiply: 



303 
X 47 



6. Multiply: 



79 
x42 



7. Divide: 



12) 168 



8. Divide: 



15) 555 



2-2 

50 



Part 2 



9. Subtract: 



803.09 
- 52.35 



A. 851.34 

B. 855.44 

C. 851.74 

D. 750.74 



10: Multiply: 



9.73 
X 4.8 



A. 11.676 

B. 46.704 

C. 45.784 

D. 16.031 



11. Divide: 



26 ) 2.86 



A. 1.1 

B. 0.11 

C. 10 

D. 1.6 



12. Solve: 

25% of 200 



A. 5000 

B. 50 

C. 5 

D. 25 



o 
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51 



13. Add: 



Part 2 



15. Simplif)': 



7.42 
35.6 
+ 122.3 



A. 232.7 

B. 165.32 

C. 154.38 

D. 311.18 



14. Add: 

64.5 + 6.27 + 18.31 = 



16. Simpliiy: 



A. 31.03 

B. 78.08 

C. 89.08 

D. 310.3 



2-4 



52 



Part 2 



17. Add and simplify: 

3^ 
+ 5! 



A. 8 14 



B. 8^ 
c. 8t 

D. 8f 



A. 
B. 
C. 
D. 



5f 

5 A 

5 4 



18. Add and simplify: 

+ 2i 



19. Add and simplify: 

+ 21 



A. 
B. 
C. 
D. 



8 12 

8 i 
8 ^ 

Q 34 
O 35 



20. Subtract and simplify: 

-4f 

-^•2 9 

B. 2 i 
c. 2 "9 

D. 2 1-2 



2-5 
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Part 2 




Part 2 




2-7 

ERIC 5 J 



SAMPLES 




© LIKE 

1.000 - one thousand ^ su^e o- 
1.000.000 i= one million vi^ Dor. i Cart 

Qj) DiSJKE 


Farcjrc •♦iroras that havt- th« sa"*. 

© LIKE 

f/.ARVELOUS , , 

/TN Nor Sj't 0* 
V::> Dor. 1 Ca't 

ROCKY ^ONDERFU^ TINY 

DiSJKt 


3. Adding numbers 

© LIKE 

29 

. - 7 Not Sure or 
Q DISLIKE 


4. Telling which number comes next ir. 
the series 

12 15 18 ©r!o>-r 

© DISJKE 


5. Making words that sound alike 

© LIKE 

PUFF — TOUGH 

/CN Not Sure or 

LEAVE — RECEIVE ^ ^^"^'^ 

© DISLIKE 


6. Multiplying big numbers 

LIKE 

69753 ^ 

X 726 No! Su^fe or 

\ZJ Don i Care 

DISLIKE 


7. Finding the missing number 

(3) LIKE 
□ + 132 = 136 ^ 

_. ^ /TN Not Sure or 
□ = ? VO' Don't Care 

Qs) DlS-IKE 


b. Doin- hard subtraction problems 
72145 ^ 

— 9897 r\ ^'o- Sure or 
\ZJ Don t Care 

DISJKE 


9. Measuring things 

J ^ Don-t Care 
^SL^ © DISLIKE 


10. Learning to spell 

© -"'-^ 

/ ^^^^'^"^ © DISLIKE 


11. Dividing numbers 

© LIKE 

16-5-4= iO\ No*. S rfe 0' 

\z) Dor. t Care 
\^ DISLIKE 


12. Solving word problems 

© LIKE 

A new bssketbal! cos: S^.oO plu? 

h^K sale> tax. Hov. much doe? the ^1°^ Su'-e o- 

bt?kv:ba!: cof; i7,f;'uc\T..c' tax'; ^ Care 

1**1 rNic*' li/c 



13. CnDC)i.:n9 t g:oc wdio ioi e sen'e.'irt 

© LIKE 

u /Ts No^ Sj'e 0' 

Hi )s Pjj^ , 

© DISLIKE 



U. Findinc out abDjt c\:tferen*. kmai cf 
nuntsers 

TEN 

No' Su't 0' 



24 



Five 

X « 10 

V - 5 

XV « 16 



©) Don 1 Ci't 
Q DISLIKE 



15. Learrano about fractions 



1 



■^ + 1 = 2^1 
4 4 4 2 



@ LIKE 

©No'. Sure Of 
Dor.'t Care 



16. Multiplying numbers in different ways 

© LIKE 

15 X 3 = (10 - 5) X 3 

©Not Su't o' 
Don-l Ca'C 



DISLIKE 



© 



DISLIKE 



17. Making up a title for a story 




© LIKE 

©No* Sjre or 
Don t Care 



18. Learning about weights 

1 kilogram = 2.2 lbs. 
1 lb. « 16 02. 



DISLIKE 



19. Learning ha^^• to use charts 



20. Working with sets 



150 
IOC 
50 H 



—I T » 1 

1955 1950 1965 1970 



© LIKE 

©Nor Sure 
Don"! Car 

© DISJKE 



© LIKE 

©Not Sure 0' 
Don'1 Cari 

© DISLIKE 
©) L.KE 



A » ;0.c . B 



©Not Sure O' 
Don't Care 

© DISLIKE 



LIKE 

©No: Sure o' 
Dor. : Care 

© DISLIKE 



</) L'KE 



©No* Sj'e 0 
Don't Care 



© 



DISLIKE 



V) LIKE 
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©No* Sure 0' 
Do'-'t Cere 

© DISJKE 



LIKE 
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©Not Sure c 
Don t Care 

© DISLIKE 



Appendix D 

Reliability Analysis of Measurement Instruments 
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Appendix D 

Reliability Analysis of Measurement Instrument! 



Reliability Analy g-i s for Ai-i-it ude Snal^ 



Number of Cases 
Number of Items 
Overall Coefficient Alpha 



207 
15 
.83 



Corrected 

Item-Total 

Correlation 



Item 


1 


.46 


Item 


3 


.39 


Item 


4 


.38 


Item 


6 


.36 


Item 


7 


.44 


Item 


8 


.49 


Item 


9 


.42 


Item 


11 


.41 


Item 


12 


.46 


Item 


14 


.51 


Item 


15 


.53 


Item 


16 


. 58 


Item 


18 


.57 


Item 


19 


.41 


Item 


20 


.43 



Coefficient 
Alpha if 
Item Deleted 

.82 

.83 

.83 

.83 

.82 

.82 

.82 

.82 

.82 

.82 

.82 

.81 

.81 

.82 

. 82 



Reliability Analysis fpr Posttest, 



Number of Cases 
Number of Items 
Overall Coefficient Alpha 



206 
52 
. 93 



Corrected 

Item-Total 

Correlation 



Part 


1 




Item 


1 


.22 


Item 


2 


.25 


Item 


3 


.41 


Item 


4 


.44 


Item 


5 


.49 


Item 


6 


. 60 


Item 


7 


,53 


Item 


8 


.56 


Item 


9 


.26 






Corrected 



Coefficient 
Alpha if 
Item Deleted 



.93 
.93 
.93 
. 93 
.93 
.92 
.93 
.93 
. 93 

Coefficient 
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Item-Total 
Correlation 



Alpha if 
Item Deleted 



Item 


10 


Item 


11 


Item 


12 


Item 


13 


Item 


14 


Item 


15 


X ^ Am 

X uem 


1 A 
J. O 


Item 


17 


Item 


18 


Item 


19 


Item 


20 


Item 


21 


Item 


22 


Item 


23 


Item 


24 


Part 


2 


Item 


1 


Item 


2 


Item 


3 


Item 


4 


Item 


5 


Item 


6 


Item 


7 


Item 


8 


Item 


9 


Item 


10 


Item 


11 


Item 


12 


Item 


13 


Item 


14 


Item 


15 


Item 


16 


Item 


17 


Item 


18 


Item 


19 


Item 


20 


Item 


21 


Item 


22 


Item 


23 


Item 


24 


Item 


25 


Item 


26 


Item 


27 


Item 


28 



.46 
.38 
.49 
.25 
.59 
.67 
.41 
. 38 
. 55 
.34 
. 37 
.41 
.31 
. 56 
. 40 



.93 
.93 
.93 
.93 
.92 
.92 
.93 
.93 
.93 
.93 
.93 
.93 
.93 
.93 
.93 



. 22 
. 15 
.40 
.38 
. 51 
. 53 
. 66 
. 58 
.46 
. 43 
. 35 
. 17 
. 17 
.27 
. 58 
. 61 
. 36 
. 34 
. 55 
. 51 
.47 
. 52 
. 40 
.42 
. 54 
. 32 
. 36 
. 38 



.93 
.93 
.93 
.93 
.93 
.93 
.92 
.93 
.93 
.93 
.93 
.93 
.93 
.93 
. 93 
.92 
.93 
.93 
.93 
. 93 
.93 
.93 
.93 
.93 
.93 
.93 
. 93 
.93 
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Analysis for Postt:...^ t^o.. 
on Whole Number operat-.i nns 



Number of Cases 
Number of Items 
Overall Coefficient Alpha 



Part 1 



206 
16 
.85 



Corrected 

Item-Total 

Correlation 



Coefficient 
Alpha if 
Item Deleted 



Item 1 
Item 2 
Item 3 
Item 4 
Item 5 
Item 6 
Item 7 
Item 8 

Part 2 



.28 
. 34 
.47 
.46 
. 53 
. 60 
.51 
.55 



.85 
.85 
.84 
.84 
.84 
.83 
.84 
.84 



Item 
Item 
Item 
Item 
Item 
Item 
Item 



1 
2 
3 
4 
5 
6 
7 



Item 8 



.26 

.27 
,46 
, 49 
56 
51 
62 
46 



.85 

.85 

.84 

.84 

.84 

.84 

.83 

.84 



fieliabili ty Analysis fnr Pnsttest Tt pwo 
on Deci mal Operations ~ ~ 



Number of Cases 
Number of items 
Overall Coefficient Alpha 



206 
15 
.70 



Corrected 
Item-Total 
Correlation 



Part 


1 




Item 


9 


.22 


Item 


10 


. 35 


Item 


11 


.31 


Item 


12 


. 40 


Item 


13 


. 22 


Item 


21 


. 39 


Item 


22 


.27 






Corrected 



Coefficient 
Alpha if 
Item Deleted 



. 69 
. 67 

.68 
.67 
.69 
. 67 
.68 

Coefficient 
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Item-Total Alpha if 
Correlation item Deleted 



Part 


2 






Item 


9 


. 38 


. 67 


Item 


10 


.40 


.67 


Item 


11 


.29 


. 68 


Item 


12 


.08 


.71 


Item 


13 


.17 


.69 


Item 


14 


.27 


.69 


Item 


25 


.43 


. 66 


Item 


26 


.30 


. 68 



Reliability Analysis on Posttest Items 
on Mixed Number Operations 

Number of Cases =206 
Number of Items = 21 

Overall Coefficient Alpha = .88 

Corrected Coefficient 
Item-Total Alpha if 
Correlation Item Deleted 



Part 1 






Item 14 


.56 


. 87 


Item 15 


.65 


.87 


Item 16 


.41 


. 88 


Item 17 


.36 


. 88 


Item 18 


.55 


.87 


Item 19 


.38 


. 88 


Item 2 0 


.39 


.88 


Item 2 3 


. 60 


. 87 


Item 2 4 


.39 


. 88 


Part 2 






Item 15 


.55 


. 87 


Item 16 


.57 


. 87 


Item 17 


.34 


. 88 


Item 18 


.40 


. 88 


Item 19 


.61 


.87 


Item 2 0 


.57 


. 87 


Item 21 


.49 


. 88 


Item 2 2 


.56 


. 87 


Item 23 


.43 


. 88 


Item 2 4 


.46 


. 88 


Item 2 7 


.41 


.88 


Item 2 8 


.37 


. 83 



60 
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Appendix E 
Full Report of Interview Responses 

The following are teacher responses compiled across the 
three interviews: 

Interview One - Sept/Oct. (9 teachers) 
Interview Two - Dec. /Jan. (17 teachers) 
Interview Three - June (17 teachers) 

Teachers have been designated with letters to preserve anonymity. 

PRETEST : 

"A" 

As of the second interview "A" said that she had not used these 
tests. 

During the third interview she reported use of the Whole Numbers 
pretest as a needs assessment at the beginning of the year. She 
went on to say that her students "had trouble in Whole Nuirbers." 
She added some could not do subtraction and some could not add 
numbers if they were in a horizontal format." Therefore she 
didn't move on to any of the other pretests. 

"B" 

At the first interview "B" said that she didn't think the 
pretests were valuable, but she agreed to administer the Decimals 
pretest. As of the second interview, she said she had given the 
Whole Numbers and the Decimals pretests. The results were used to 
select the diagnostic evaluations. 

By the final interview "B" used the Mixed Numbers pretest. She 
said the tests were given to the entire group and the results 
were used to select software programs. She discontinued use of 
these because the diagnostic test proved to be more valuable. 

"C" 

At the first and second interview "C" said she was too busy 
preparing for the MFMT to use the materials. She said she was 
skipping around the math curriculum to meet the needs of the 
school's test schedule. 

As of the third interview she said she used the Number Concepts, 
Whole Numbers, Mixed Numbers, Decimals and Problem Solving 
pretests. She used them each time she "started a new unit to 
indicate where work was needed." At the end of the unit, "C" 
gave the posttest and gave both assessments back to students for 
comparison. She said she wanted the students to "see if they 
had made any of the same errors. "She continued to use these tests 
to monitor student progress. 
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"D" (no interview #1) , , • ^ 

At the time of the second interview she could not recall if she 

used any pretests. 

During the third interview she reported that she used these tests 
but not on a regular basis early in the year. "D" prepared 
manipulations on her own and it would have been too much trouble 
for her to go downstairs and pull the materials each time she saw 
a problem. 

[I think "D" was unsure of the purpose of the pretest. Also even 
though we gave each teacher a copy of the materials, they were 
stored in the computer lab downstairs] 

"E" 

"E" used the Whole Numbers and Number Concept pre-tests by the 
time of the second interview/. She used the answer key to score 
them and the results determined which diagnostic tests to give. 
As of the third interview she used Mixed Numbers and Decimals 
pretests. The results were used in the same manner as stated 
above. 

iipii 

"F" gave the entire set of pre-tests at the beginning of the year 
as a baseline. 

"G" (no int.#l) ^ „ ^.v. 

As of the second interview she did not use the pretests. By the 
thiri interview she used the Whole Numbers, Mixed Numbers and the 
Decimals pretests. "G" said she used the answer key to score 
them. 

"H" 

"H" used the Whole Numbers and Number Concepts pretests. He 
scored them using the answer key. During the second interview he 
said his students were not ready to go any further. Yet, at the 
third interview he mentioned that he used the Problem Solving 
pretests. He didn't use these tests for other areas such as 
Decimals because of "class experience", he knew they would score 
low, so he used the text instead. 

"I" (no int#l) ^ ^ ^, 

"I" used them early on with her students. She used the results 

to get an idea of where to begin instruction. 

"J" 

"J" reported using the Decimals pretest at the time of the first 
interview. She did not use any pre-tests since then because of 
the arrangement she and "I" had with their students. "J" only 
took the students to the computer lab. 

After the first interview she stopped teaching math completely 
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and only worl^.ed with them in the computer lab. 
"K" 

As of the second interview "K" used only the Decimals fretest. 
The results were used to select the diagnostic tests. He used 
the answer key to score it. By the third interview he used the 
Mixed Numbers test. "K" said he discontinued use of these tests 
for no particular reason. 

"K" told us that the tests could be improved if the formatting 
was different and the print was made larger. The decimal point 
were too small and they blurred when reproduced. 



"L" 

As of the third interview "L" had used the Number Concepts 
pre-tej5t only. She discontinued use of these tests because she 
said she already knew what domains and objectives to work on. 
The following teachers were not a part of the first interview: 

••M" 

"M" said she used the pre-tests based on the students need for 
work. The tests were used in conjunction with the students 
ability level within their math program with their regular math 
teacher. She gave the Decimals pretest using the scantron to 
score and the results to teach the students. 

By the time of the third interview "M" had used the Number 
Concepts, Whole Numbers and the Mixed Numbers pretests. She 
continued to score the tests in the same way. 



"N" 

Gave the Whole Numbers pre-test at the beginning of whe year. By 
the time of the third interview he gave the Number Concepts and 
Decimals pretests. The students answered the questions directly 
on the test so "N" could find out in which part they were falling 
down. He said that it was very helpful to have these tests a few 
weeks ago when he got a new student. He gave the student the 
tests and could find out right away where he needed to be. 



IIQII 

By the second interview "0" had given the Whole Number and 
Decxmal pretests. She is ready to do the Mixed Numbers one. as 
of the third interview she had given the Mixed Numbers, Number 
Concepts and Problem Solving tests. These were scored by using 
the scantron forms. However, she said her students had to hand 
in a separate sheet that showed the problems worked out, so they 
"wouldn't just guess at the answers." 

npii (THIRD INTERVIEW ONLY) 

"P" gave these tests early on but not the second half of the 
year. The second semester she worked mostly on fractions/mixed 
numbers operations. She said the students needed everything. 
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she gave a total instruction approach so there was no nead for 
these tests. 

"Q" (THIRD INTERVIEW ONLY) 

"Q" used these pretests at the beginning of the year only to 
prepare for the MFMT. 

****** 

DIAGNOSTIC EVALUATION: 

"A" 

"A" did not use any diagnostic evaluations as of the second 
interview. By the time of the third interview she used the 
Number Concepts and Whole Numbers pretests. She gave the tests to 
assess "where they were" but did not use the task analyses part 
of the tests. She used the matrices initially to select software 
for students. Then she allowed the students to choose software 
based on the area they were working on in class. For example, if 
they were doing multiplication, the students would choose either 
Milliken or Multiplication Puzzles. Sometimes she made them do a 
harder program than they would select. 

"B" 

"B" used the diagnostic tests at the beginning of a new unit. She 

had used the Decimal and Whole Numbers at time of the first 

interview and she did not report use of any other ones by the 

second interview. "B" used the results to select software. 

At the time of the third interview she used the Mixed Numbers 
pretest. The tests were given as group tests and were scored 
according to skill level and then used to correlate software from 
the matrix. She continued to use these tests because they were a 
quick way to see what else the students needed. 

"C" 

At the first interview "C" reported that she did use the 
diagnostic tests . She used Whole Numbers and Word Problems. 
They were duplicated and she scored them herself. During the 
second interview, she reported that she did not use these test 
regularly and sne planned to start using them. 

As of the third interview "C" reported using the Number Concepts, 
Mixed Numbers and Decimals diagnostic evaluations. 

However, she ended uy using these tests as worksheets and 
warm-ups which is not how they were intended to be used. . [SEE 
MARY'S EXPLANATION OF THIS IN THE THIRD INTERVIEW]" 

D" (no interview #1) 

"D" worked with "G" at the beginning of the year and was not sure 
if it was given or not. 
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She gave the Mixed Number diagnostic evaluations only as a 
baseline. She then used these same tests for a comparison after 
teaching the material, she mentioned that she didn't include the 
scores in her grading. "D" corrected both tests without the 
answer key. She did not always take the answer key with her - as 
the materials were downstairs in the computer lab. 

II EH 

At the time of the first interview, "E" said the Number Concepts 
diagnostic evaluations were being copied for her use. She gave 
the students only the necessary diagnostic tests. 

As of the final interview, "E" had used the Whole Numbers, Mixed 
Numbers and Decimals pretests. She used the results to see what 
the students already know and to identify the areas where the 
students needed work. 

iipii 

"F" never made use of these evaluations, she said the Pre-test 
was enough. 

"G" (no interview #1) 

As of the third interview, "G" used the Whole Number and the 
Decimals. She used the results as a needs assessment. She said 
that her students did very well on the tests and commented that 
she only used them "somewhat.^' "G" said that she '^harted all the 
information on her students early in the year and was able to 
come up with her own diagnostic materials. At one point in the 
interview she commented that all the materials were downstairs, 
in the computer lab and that was one reason why she just didn't 
get to more of them. 

"H" 

"H" gave the Whole Numbers diagnostic evaluation only. These 
were given because they were previously copied for him by the 
computer coordinator. 

"I" (no interview #1) 

As of the second interview, "I" did not use these tests. "I" was 
not interviewed again. 

IIJM 

As of the time of the first interview, "J" had given the Decimals 
diagnostic evaluations. Results were used as a baseline. In 
subsequent interviews, "J" informed us that she no longer used 
any of the math materials, other that the software. "I" did all 
the math instruction and during "J"'s English period, she took 
the students to the computer room twice a week. 

She would consult with "I" as to the level of the students and 
then would choose software accordingly. 
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"K" 

"K" used the multiplication of Decimals and the Mixed Numbers 
diagnostic evaluations as of the third interview. He 
discontinued use of these tests, as with the pretests for no 
particular reason. 

He used the software matrix and the software summaries to select 
the software for his students. He also used trial and error. 
"K" said that he concentrated on Whole Numbers, Decimals and 
fraction operations while in the lab. The Whole Numbers software 
was the most available. Often when they were working on Decimals 
and fractions, etc. they practiced with Whole Numbers on the 
computers. "K" said that not only is there more software in this 

area, but also the apple computer does not run half of the 
software for the other domains. 



II Lii 

As of the third interview, "L" used only the Number Concepts and 
Decimals diagnostic evaluations. She discontinued using these 
tests because she knew what areas to cover based on the Math 
teacher's discretion. She had to cover all areas in certain 
domains. She also mentioned that she had too many students, and 
to get so specific with each child was too much. 

Instead, when she was covering fractions with her students, she 
went directly to the software that covered fractions. 

"M" (no int. #1) ^, 
"M" reported using these evaluations in a variety of ways. She 
used the Number Concepts and Measurement evaluations as teaching 
tools since students had not been exposed to these things before 
ond therefore a pretest would not be appropriate. She used the 
Mixed Number/Fraction diagnostic tests as continuing pre and post 
tests to keep on target with the fractions. It was a kind of a 
cycle where she had to keep checking to see if they were getting 
it. 

"N" (no int. #1) . 
"N" gave all of the Whole Numbers, Number Concepts and Decimals 
diagnostic evaluations by the time of the final interview. He 
used the results to place students at appropriate levels. For 
e=ich incorrect response, "N" marked the skill number by it to use 

r software selection from the matrix. He said he will really 
appreciate the revised materials that will have the skills noted 
next to each item on the test. 

"0" (no int. #1) 

"0" used only the Mixed Numbers Diagnostic Evaluations. She gave 
the tests to see where the students skills lied within the Mixed 
Numbers Operations domain. She did not use the other diagnostic 
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evaluations because the pre and posttests sufficient to her 

needs. The Milliken Math Sequences Courseware has a pre and 

post-test that correlates with the software. 

"0" used the matrix to find the main categories of software 

needed. She then read the Software Summaries for those programs 

and finally she previewed disks to see if the software was 

appropriate. 

Interviewed once for the third interview only: 

npn 

"P« said she used these tests mainly as a way to pair kids and to 
get groupings. She matched the students in homogeneous pairs at 
first, then eventually led to a heterogeneous mix of groups 
matching them according to their behavior. This second approach 
v;ork«d best for her. 



"Q" 

"Q" used the diagnostic evaluations mid year to identify 
strengths and weaknesses for preparing the seventh graders for 
the CAT for next year. 

•k -k -k -k -k it 

DOMAIN directory: 
"A" 

During the first interview, "A" said she used the vocabulary 
section in the appendix of the domain directory. By the final 
interview "A" had flipped through it glancing at the strategy, 
vocabulary, ai^d common errors sections to get information about 
the area she was teaching. 

"B" 

"B" used the domain directory at the start of the year for the 
task analyses of the objectives. She said she stopped using it, 
because she didn't have a need for it. 

"C" 

"C" has been using the vocabulary section on an occasional basis. 
She has used the Strategies and Common Errors section at the 
beginning of a new uni' 

"D" (No int. #1) . ^ 4. ■ 4.V, 4- 

"D" said she thumbed through it once looking at the sections that 
related to where her students need help. She has not referred to 
it since. 

II £11 

"E" used the Domain Directory occasionally throughout the year 
mostly for information about strategies and the task analysis. 

68 



71 



"F" never looked at the Domain Directory. Her reason was lack of 
time. 

"G" (no int. #1) ■ ^ ■ 

"G" reviewed the Domain 0irectory and during the second interview 
commented that she liked the way it was organized, but she did 
not use it and felt no need for it. 

"H" 

"H" never looked at the domain Directory. 
"I" (no int. #1) 

"I" only looked at the Domain Directory one time. 
II J II 

"J" looked at the Domain Directory only once this year. 



"K" 

"K" used the Directory occasionally early in the year to get 
a feel for the model. 

"L" 

"L" used this part of the model at the beginning of the year 
to become acquainted with the project. She did not feel a 
need to continue using it. 

THE FOLLOWING TEACHERS WERE NOT A PART OF INTERVIEW # 1 
"M" 

"M" used the Directory early in the year for various reasons. 
She used the strategy section when she needed to re-teach a 
concept to a student. She has also used the vocabulary section 
and sent a list home to parents so that they can help their 
children at home. She used thr student progress sheet as well. 

"N" 

"N" reviewed the Domain Directory only at the start of the year. 
He used the student progress sheet all the time. 

"0" 

"0" used the Directory to get ideas for teaching beginning 

concepts in Number Concepts, Mixed Numbers and Whole Numbers. 

She used the vocabulary and strategy sections. 

II pii 

"P" said she used the Domain Directory twice in the second half 
of the school year to see the strategies for teaching Mixed 
Numbers Operations. She said it was very useful. 
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IIQII 

"Q" used the Domain Directory occasionally for about a month when 
she was working with a group of five students who had a problem 
in one area. She wanted a strategy for adding and subtracting 
fractions that included borrowing, but the Domain Directory did 
not cover that. 



MATRIX: 



"A" 

"A" reported using the matrices at the first and third interviews 
but not at the second interview. She mentioned that the matrices 
were used to identify where the kids were already working. 

[AGAIN, I THINK SHE WAS CONFUSED AS TO WHAT THE MATRIX SECTION 
WAS] 

IIQII 

"B" used the matrices often and said that it was very helpful to 
have them. 



"C" 

When "C" started using computers in her lessons she told us that 
the computer aide helped her select software. By the final 
interview she was using the matrix at the beginning of a unit to 
make a list of available software. 

"D" (no int. #1) , 
"D" did not use the matrices until midyear. At the second 
interview she said that "E" recently helped her use it for 
software selection. During the third interview she stated that 
she and the computer coordinator (director of the lab) looked at 
it together and he guided her as to whether software was 
appropriate or not. 

"E" 

"E" helped other teachers to understand and use the software 
matrices, but she rarely used them herself. She would tell the 
computer coordinator what her students were working on in class 
and he would select the software for her students to use. 



II pii 

The computer coordinator, who was in the lab with each c 
selected software for "F'"s class as well. 



IIQII 

"G" did not use the matrices until late in the year. Even then 
she said she used them occasionally because the computer 
coordinator did most of the software selection. 
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"H" 

"H" did not use the matrices. He had the computer coordinator 
select all the software for him. 

"I" (no int.#l) 

"I" said that she became frustrated when she first started using 
these because they often didn't have the software that was 
suggested or the software did not run on the Apple 11+ . So she 
stopped using them and went directly to the box of software to 
select programs. 

MJM 

"J" did not use the matrices. She selected software by 
previewing it and she stayed with only a few programs the entire 
year. 

"K" 

"K" used these by mid year but he also became frustrated with 
them because the software listed was either not available or it 
did not run on the Apple 11+ . He would select software by seeing 
what was available in the box of programs and use the summaries 
to help with the review of them. 

" L" 

"L" did not use their, either and went directly to the software for 
selection. 

••M"(no int. #1 ) . 
"M" used the matrices regularly. She said she enjoyed the 
variety of software and putting the students on different disks. 
Her students also enjoyed working on something different than 
their neighbor. 

"N" 

"N" used the matrices to put the students on the next skill when 
they had completed one. He used them often. 

"0" 

"0" used the matrices occasionally. She duplicated them and 
put them in her planbook for a quick reference to the software 
that was available and related to the skills covered in class. 

II pii 

"P" said she used the matrices only once at the start of the 
school year. 

"Q" 

"Q" only used the matrices once this year when she was working 
with a small group of students who needed extra help in one area. 

****** 
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SOFTWARE SUMMITRIES: 



r 



"A" 

"A" used these summaries often. She said they helped her to 
better explain a software program to her students. It was easier 
to answer students' questions about a program when she had read a 
summary. 

11311 

"B" used the Software Summaries each time she needed a new 
program. She was particularly impressed with the Teacher Options 
section. She said it was easier to read about the options 
offered on a program rather then attempting to find out about 
them by "playing around" with the program. She read the 
Summaries and then told her students what to expect from a 
program. "B" mentioned that this process made it easier for the 
students to "catch on." 

"C" 

"C" referred to the Software Summaries often to get information 
about the appropriateness of a program for her students. She 
also read them to check on software that was selected for her 
class by the computer aide. 



"D" (int. #1 only) 

"D" said she used the Summaries early in the year to familiarize 
herself with software. As the year progressed she used the 
summaries less and began to work more with the computer 
coordinator. He helped her select software and she became more 
familiar with the MECC programs. 

"E" 

"E" rarely used the Software Summaries. She skimmed through them 
once but generally went to the software program and to the 
computer coordinator for software review. 

iipii 

"F" did not use the Summaries until the second half of the year. 
She said they were quicker to use, than previewing the software. 

"G" 

"G" only skimmed through the Summaries occasionally to become 
familiar with the software. She did not begin using these until 
the second half of the year. 



"H" 

"H" did not use the Summaries until the end of the school year. 
He used them to see what software is available for his daughter's 
use during the summer. 

"I" (no int.#l or #2) 
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"I" reviewed them once but did not continue to use them. 
"J" 

"J" used the Summaries early in the year but discontinued using 
them. She went directly to the programs for software selection. 

"K" 

"K" reported using them quite frequently. They provided him with 
the most information, so he would skip the matrices and go 
directly to the summaries. 

II L" 

"L" used the Software Summaries early in the year to become 
familiar with the software. She used them less as the year 
progressed and she became more familiar with the software. 

"M" (no int. #1 ) 

"M" said that she is already familiar with most of the software 
in the project and does not need the software summaries. 

"N" 

"N" said he used them frequently to get content information about 
software programs. He said he also appreciated the management 
options. 

"O" 

"O" did not report using the summaries until after the midyear 
interview. She then used them frequently to get an idea of what 
was on a disk for preplanning for her class. She said the 
summaries were helpful for determining what activities were 
appropriate for her students skill levels. "O" mentioned that 
all three sections of the summary were helpful. She used 
information in the Suggestions section, such as the vocabulary, 
to instruct students in the classroom before going to the 
computer lab. 

M pll 

"P" used the summaries to get more in depth information about 
software that she had general knowledge of. She used them when 
she was searching for software that handled unlike denominators. 
She also used the summaries to compare a program called 
Adventures With Fractions with Conquering Fractions and Fractions 
Concepts. She found that the strategies used in Conquering 
Fractions most resembled those used by the math teacher she 
worked with."Q""Q" did not use the Software Summaries because she 
felt familiar with the project software already. 

****** 



SKILL SHEETS: 
"A" 
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"A" didn't begin using the Skill Sheets until after the time of 
the second interview. Once she began using them, it was quite 
frequent. She used them as quick quizzes and she sometimes 
taught from them. 

IIQII 

Used the Skill Sheets as warm-ups in the classroom before going 
to the computer lab. 

Used the Skill Sheets consistently through the year for warm-ups 
and quick post computer evaluations to measure the students 
progress. 

"D" (int. #1 only) 

"D" used the Skill Sheets in the classroom and the computer lab. 
In class the students worked with them for twenty minutes before 
going to the computer lab for the remainder of the mod. In the 
computer lab the Skill Sheets were used with small groups on 
tables in the back of the lab while other groups of students were 
at the computer. 

II £11 

"E" did not begin using the Skill Sheets until midyear, after the 
time of the second interview. She used them as they were 
intended to be used: as quick quizzes after the computer work, to 
see if her students were ready to move onto the next skill area. 

iipii 

"F" used them occasionally in class as warm-ups. 
"G" 

"G" did not use them because she felt they were not enough of a 
challenge for her students 

"H" 

"H" said he "used the heck out of them." He used them for 
classwork and homework. They were used as warm-ups and 
worksheets. He even added problems to the back of them 
increasing the number of problems from five to often twenty. 
They were never used as quick quizzes. 

"I" (no int.#l) 

"I" used the Skill Sheets as practice sheets for class and 
homework. 

njii 

"J" discontinued use of the skill sheets because her involvement 
with her students was limited to the computer lab only. She did 
not provide any other math instruction. 

"K" 
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"K" used the Skill Sheets consistently as they were intended to 
be used, as quick quizzes to evaluate transfer from computer work 
to paper and pencil. He also used them as warm-ups in class. 



"L" 

"L" used the Skill Sheets mainly for class and homework. She 
evaluated her students' performance by using the evaluations 
developed by the math teacher she worked with. 

"M"(no int. #1 ) 

"M" used the Skill Sheets as warm-ups and quick reviews. She 
used them to teach from in class when a student was having 
trouble with a skill. 

"N" 

"N" said he used the project Skill Sheets occasionally. He 
mostly used the worksheets provided by the Milliken software that 
his students practiced with, because they directly matched the 
software. 

"O" 

"O" used the Skill Sheets quite often for a variety of 

activities. They were used as timed activities, pop-quizzes, 

warm-ups and classwork. 

Ilpll 

"P" said she used the Skill Sheets occasionally on every third 
visit to the computer lab as a quick quiz after using the 
software "to see if there was a screen to paper transition." She 
said the students see them and see the connection to what they 
are doing in class. 

HQ II 

"Q" used the Skill Sheets often all year as homework and 
classwork. 

****** 

software: 

"A" 

"A" recalled using the following software programs throughout 
year: Number Munchers, Speedway Math, Clockworks, Arithmetic 
Critters, Fraction Munchers, Multiplication Puzzles and 
Conquering Whole Numbers by MECC and Miliiken Math Sequences. 
The three programs that helped her students most this year were: 
1) Number Munchers, because of the variety of ways to do basic 
math; 2) Multiplication Puzzles, because it helped to teach the 
students and reinforce their skills and 3) The Market Place 
because the students who used this had to "think and make 
decisions. They had to be shrewd business people." 
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••B" used software for each domain that she covered this year. 
She used the following software programs this year. Number 
Munchers, Sp-^edway Math, Subtraction puzzles, The Market Place 
and Fraction Munchers by Mecc, and Mil liken Math Sequences. The 
three software programs that "B" said were most useful to her 
this year were: 1) Challenge Math which was not on the project's 
list. This program apparently had a game-like format that forced 
the students to think about the problems that they weia 
attempting to solve; 2) Space Subtraction and Subtraction 
Puzzles, because the students enjoyed them; and 3) Fraction 
Munchers, because she saw a carry over to the same problems that 
this program offered to similar tasks on paper and pencil 

"C" 

"C" listed the following software that she used this year: 
Mil liken Math Sequences' and Word Math, Mecc's: Number Munchers 
and Speedway Math and Mindscape's Microcomputer Workshop. The 
three software programs that she believed helped her students the 
most this year were: 1) Number Munchers, because it reinforces 
previous learning; 2) Fraction Concepts, because it takes the 
student through the different levels of fractions and 3) 
Challenge Math, which was not on our list of project software, 
because it has all types of problems and the students really 
liked it. 

"D" (int. #1 only) 

"D" said that Conquering Whole Numbers by Mecc was the most 
helpful software program used by her students this year. 
Additionally, she mentioned Mecc's Number Munchers and Fraction 
Munchers as programs that gave practice in factors and multiples 
plus were enjoyed by the students. 



"E" 

"E" said she used software for each of the domains that she 
covered in math this year (See Pretests) . The software programs 
that helped her students most this year were Conquering Whole 
Numbers and Number Munchers i:v Mecc. 

iipii 

"F" reported that software was used for each domain that she 
covered this year. The program that was used the most during th - 
first half of the year was Conquering Whole Numbers by Mecc. She 
said that this program eventually became "work" for them, so she 
used other programs to cover basic skills. The three software 
programs that she believed helped her students the most this year 
were: 1) Number Munchers, because it helped the kids with 
multiplication facts yet has a game-like format enjoyed most by 
the students; 2) Speedway Math and 3) Market Place were two other 
programs that "F" said were helpful. 



UQU 

"G" said that software was use-^ in every domain covered this year 
except Percents. She could only recall the program Conquering 
Whole Numbers as the one used by her students. She said the 
computer coordinator would know about other programs that her 
students worked with. 

"H" 

"H" said that software was used in the Whole Numbers, Word 
Problems and Decimals domains. He said his students used the 
program Conquering Whole Numbers most of the time but the 
computer coordinator could name other programs used by his 
students . 

"I" (no int.#l or #3) 

"I" used various Mecc software programs in the areas of Whole 
Numbers and Decimals. 

II jn 

"J" did not begin using software until after the first interview. 
The programs that she used initially with her students were: 
Conquering Whole Numbers, Multiplication Puzzles and Speedway 
Math. Further along into the year she began U'=".ing simulation 
software with her students in small groups. The h.r'.et Place by 
Mecc, suggested by our project was one. Two other .urograms 
Oregon Trails and ODeer! were non-math software, but "J" 
considered them to be valuable because they required higher order 
problem solving. She said her students really enjoyed these 
programs. 

"K" 

By the time of the second interview "K" had ^ust begun using 
software with his students. Software was used for each of the 
domains that he covered this year but not so much for the 
Fractions/Mixed Number Operations domain due to the 
incompatibility of software to hardware. (Much of the designated 
software did not run on the Apple 11+ computer.) He listed many 
software programs that he used with his students this year and by 
the second interview he was already using: Conquering Whole 
Numbers, Speedway Math, Multiplication Puzzles, Decimal Concepts 
and The Marketplace by Mecc. He also used Mindscape ' s 
Microcomputer Workshops Courseware. "K" ranked three software 
programs that were the most useful to his students this year: 1) 
Multiplication Puzzles; 2) Number Munchers and 3) Conquering 
Whole Numbers. 

II Lii 

"L" used software as much as possible for each domain that was 
covered in math class this year. However, there were three 
domains. Number Concepts, Measurement and Using Data where the 
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software was either inappropriate or not available for the 
students. During two of the interviews "L" expressed a desire 
for a larger variety of software. For example she wanted 
programs that presented graphs with pre-existing information for 
the students to manipulate. She listed the following software as 
programs used this year: Number Munchers, Speedway Math, 
Conquering Whole Numbers, Decimal Concepts, Multiplication 
Puzzles and Quotient Quest. "L" never mentioned the top three 
software programs that were most helpful to her students. 

"M" (no int. #1 ) cv, 
"M" used software for each math domain addressed this year. She 
used a variety of programs that included: Milliken's Math 
Sequences, Mecc ' s Study Guide, Quickflash, Multiplication 
Puzzles, Quotient Quest, Conquering Whole Numbers and Speedway 
Math. The three programs that were most helpful to her students 
were: 1) Milliken Math Series, 2) Mindscape's Microcomputer 
Workshops and 3) Mecc's Conquering Fractions, all because they 
operated in small steps. 

"N" 

"N" used many software programs for each of the domains that he 
addressed this year. He additionally used the program Clockworks 
by Mecc even though he didn't teach the domain that lists this 
program. He intended to use a program named Moneyworks but it 
did not run on the Apple 11+ computers that were available to 
him. He used the program The Market Place as reward for his 
students who had the appropriate reading ability. Other programs 
listed by "N" were: Milliken's Math Sequences, Mecc's Space 
Subtraction, Addition Logician, Multiplication Puzzles, Quotient 
Quest and Arithmetic Critters. "N" named two programs that were 
most useful to his students this year. The first one is 
Milliken's Math Sequences. He said this series deals with 
borrowing and carry over. "It tells them exactly when to do the 
borrowing." In class when they would do similar problems and 
forget what to do, "N" would tell them to" remember how the 
computer does it" and then they would remember. The strategy 
that "N" used to teach addition of decimals was the same as 
Milliken's strategy, so again his students benefitted from 
consistency of instruction. The second program is Mindscape s 
Microcomputer Workshop. He specifically told us that he 
appreciated the remedial feedback of this program. If a student 
responded incorrectly twice, the program graphically highlighted 
the numbers to be dealt with by enclosing them in a box. He 
said often the students would press the Return key twice DUst to 
get to this part. 

"0" 

"0" said that software was used in each of the domains that she 
covered this year. She used the following programs: Milliken 
Math sequences, Mecc's Adventures with Fractions, Fraction 
Practice Unlimited, Fraction Munchers and Conquering Fractions. 
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The programs that she felt were most valuable for her students 
v/ere Mil liken Math Sequences because they were ordered 
sequentially and Mindscape's Microcomputer Workshop because of 
the way it presented fractions. 



"P" said she used software to reinforce skills in the Whole 
Numbers and Mixed Number Operations domain. Even though the math 
teacher she worked with covered other domains, "P" reported that 
their students needed constant reinforcement in these areas. The 
three programs that helped her students the most this year were 
Conquering Fractions, because the presentation was similar to one 
used in the text. Conquering Whole Numbers and Number Munchers 
because they were very motivational and achievement oriented 
programs. 

"Q" 

"Q" used software all year with her students. She particularly 
enjoyed a program called Mecc Graph which she used for math, 
science and social studies classes. She said the students had to 
plot points in science using the x and y axis and social studies 
they had to learn longitude and latitude. "Q" used Mecc graph to 
show her students the similarities and her students were thrilled 
to figure out that the same kind of process v;ould work in several 
of their classes. The math software that "Q" believed helped her 
students most this year were: 1) Milliken Math Sequences, because 
cf the gradual approach; 2) Fraction Munchers, because of the 
game-like approach to covering basic fraction skills and 3) 
Speedway Math, because it was a good reinforcement of skills 
before moving ahead. 



MISCELLANEOUS MATERIALS: 



"A" 

Did 



not use these materials. 



11311 

Did 



not use these materials. 



"C" 
Did 



not use these 



"D" 
Did 



(int. #1 only) 
not use these. 



"E" 
Did 



T"ot use them 



Did 



not use them 
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IIQII 

Did not use them. Were not challenging enough for her students. 
"H" 

Did not use these materials. 

"I" (no int.#l) 
Did not use these. 

IIJII 

Did not use these 
"K" 

Used them but was not pleased with them, [he basically used them 
because we asked him to give us feedback on them] 

"L" 

Did not use them. 

"M"(no int. #1 ) 
Did not use them 

"N" 

Did not use them. 

IIQII 

Did not use them. 



GENERAL EVALUATION 



Question 1: 

"What changes have occurred in your method and approaches 
toward teaching math, since becoming part of the Middle School 
Math Project?" 



Question 2; 

"Have 
think they 



the students benefitted from this project? Do you 
learned more?" 



Question 3: 

"Rate your level of comfort (on a scale of 1 = very 
uncomfortable to 5 = very comfortable) with using computers in 
tec^-ching before becoming a part of the Middle School Math Project 
and what changes have occurred in your attitudes and approaches 
coward using computers, 3ince becoming part of Project?" 



Question 4 

"in the coming school year, how do you 
using computers and the instructional Model 
requirement cf data collection and a 
of computer time for students?" 
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perceive yourself 

v;ithout ths^ 

times a wf-ek.' minimum 
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Question 5 

"Name one positive event that has happened since the 
implementation of this model in your school." 



TEACHER RESPONSES 
"A" 

1. Teacher "A" taught more from our project materials than from 
a textbook. In frjt, she has not been able to find a suitable 
textbook for her students. 

2. She said the students have benefitted tremendously. She also 
believes they learned more. One student, could not count and now 
he can do so and tell tims (she believes) from using Clockworks. 

3. She rated herself a 3 at the beginning and now is a 5. She 
enjoys using the computers and wishes the project had more 
programs in other content areas - especially science. 

4. She feels that she will use the program including the 
computers in much the same way next year as she has this year. 

5. Positive event: The students want to use computers to learn 
rather thai, ju^t to play games. She overheard a student say to 
another student, "We come here (the lab) to learn, not just to 
play games.*' B\e also mentioned that students do see the 
correlation between the work they do in the class and on the 
computer. 

1. Teacher "B^' has used the computer more. 

2. "Yes, students have benefitted and learned more. They have 
also become computer literate." She alluded to something about 
the SPED kids not being able to use -romputers in high school 
because they don't know how to operate them. "Their math has 
improved and they have been forced by the computer to memorize 
their multiplication facts." 

3. Her comfort level went from a level 1 to a 5 and she said 
she wants more computers and wants to have one in her classroom. 

4. In the coming year, she sees herself continuing to use the 
math. She would like to expand to another subject area and also 
to have her students learn word processing so they could use the 
computer to write reports. 

5. One positive event* "The students have gained self 
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confidence in using the computer and their math knowledge has 
increased. " 

iiC« 

1. Teacher "C" said that the project has made her aware of the 
sequence one has to follow in teaching math. The software forces 
the student to do a problem in a particular way so you can let 
the students know that there are other ways of getting an answer. 
They understand that when working on the computer, they must do 
it the way the coinputer is programmed. 

2. The students have benefited from the project. "The computer 
gives them a different p.venue for doing math. Most kids enjoy 
math or want to enjoy it and they do enjoy it with the computer." 

3. Level of computer comfort before the project, was a 1. After 
the project, a 3. Teacher "C" responded that she is no longer 
afraid of the computer. When something goes wrong, she realizes 
it is not necessarily because she did something wrong. It may be 
that the disk is not working. 

4. She will use the computers with students next year if the 
time can be allotted. 

5. One positive event: The children look forward to the computer 
lab for math - not just for games. They also can see a 
correlation when using other math software with programs they the 
project and they will tell her that "we could have used this disk 
when we were doing such and such." 

"D" 

1. The dominant change that occurred in her was the knowledge 
that she can "use the computer room for practical application and 
math practice." Also knowing that she had some other option for 
teaching made a difference. 

2. Yes the students have benefitted from this project. If 
nothing else, they saw that what was on the blackboard and paper 
in class is also in computer technology. For some reason that 
amazed them. Perhaps they are so used to arcade type games that 
"educational" games were not in their expectations. 

3. "D" rated her level of comfort with using computers since 
becoming a part of our project at 3. She is now very comfortable 
with using computers and sees the potential for it's uses. 

4. Next year she would like to have the same schedule as this 
year if time allows. At least twice a week. 

5. One positive event: "Students have become more interested in 
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math and look forward to using the computers." 
HE" 

1. "E" said that she has not done anything different except 
incorporate the materials into what she usually does. 

2. She believes the students have benefited and learned more. 

3. Level of comfort with using computers before the math project 
was a 1. "E" is now comfortable with using computers in teaching 
and plans to use them in other subject areas in the future. 

4. In the coming school year "E" will try to uFe the computers 
same as this year if time allows. 

5. Positive event: The computers helped a borderline student 
"like" math more. 

Information on Teacher "P" not available. 

1. "G" reported no changes in methods and approaches toward 
teaching ma!: 

2. She said yes the students benefitted from this project, 
because of the "motivational, one-on-one, step by step approach" 
it uses. 

3. Her level of comfort with computers before the project was a 
4 and it has remained as such. 

4. Information not available. 

5. Information not available. 
"H" 

1. "H" said that it was unusual for him to have a group of 
students such as the class he had this year. He spent all year 
on three domains due to their level of ability and attitudes. He 
altered his method and approaches but these changes were not 
related to the project. 

2. "H" reported that students have benefited and learned more as 
a result of this project. 

3. He rated his level of comfort with computers before becoming 
a part of this project at a 1 . His attitude toward using 
computers chanaed greatly. He said he "loves them" and he's 
looking forward to branching into English and Reading next year. 
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4. He intends to use the computers as much as possible in all 
areas next year. 

5. "H" said the positive thing that has happened as a result of 
this model is that the students are more enthusiastic on "lab" 
days then when they are in class. 

Information on Teacher "I" not available. 

• IJH 

1. Teacher "J" doesn't teach math. She works with a co- 
teacher's students only when they use the computers. 

2. Her response was "yes absolutely", the students benefited 
from using this project. 

3. "J" gave hers'.elf a comfort rating of 3 since becoming a 
part of this project. She reported no changes in her attitude 
toward using computers. 

4. Next year she hopes to bring the students in the lab three 
times a week. She hopes to use the computers for reading and if 
she teaches math, she plans to use the entire model. 

5. Positive Events: "J" had a student from Cambodia who had no 
skills in early math, he was excited and motivated to learn on 
the computer. She had two non-readers in her group and they 
loved Oregon Trails, there's a lot of reading in that program and 
the non-readers allowed the others to help them with the text on 
the screen without feeling embarrassed 

"K" 

1. Teacher "K" said he was able to individualize more, since 
the project rvsguired computer use and their school had such a 
small computer lab. He was forced to put his students in smaller 
groups and spent luore time on specific skills than usual. He was 
more independent [than when he stayed the classroom with the 
math teacher] and able to stay with a concept for longer periods 
of time. 

2. He said his students benefited from this project. His 
students were highly motivated and because of the computers, the 
incentive for them to be in math was there. The math teacher 
believes that students showed for class on days that they were 
scheduled to use the lab. 

3. "K" gave himself a high rating because he was always 
comfortable with computers. He has one at home tha-»- he uses 
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quite a bit. He hasn't had the opportunity to use computers 
with students until this project. He said he is now more 
familiar with how they are used during instruction. He has more 
ideas for integrating now. 

4. He plans to use the computer in the same way next year if 
possible. He feels it's important to be consistent, and hopes to 
use them three times a week. 

5. Positive Event: He noticed that his special education students 
had a positive attitude towards learning math. 

"L" 

1. Teacher "L" reported that using the computers is the change 
in her approach. 

2. She feels the students have "def init-.-ly" benefited from this 
project, "it enhances their math skills using a different medium. 
The skills are presented in a different way and the students are 
forced to follow directions." 

3. Her level of comfort with using computers has always been 
very comfortable. She also said that no changes occurred in her 
attitude toward using computers in teaching because she always 
felt positive about them. 

4. Teacher "L" said that she perceived herself using the 
computers and the model next year. She would like to 
individualize her students program more and most of that depends 
on re-arranging the schedule, she said she had too many students 
this year at one time and at the very last mod of the day. 

5. Positive event: Her students are computer literate now, they 
"process information better, their skills have improved, and 
they transfer skills more easily." 

"M" 

1. Teacher "M" reported " I individualize more and have become 
more aware of specific skills and concepts that kids lack." She 
said that she had a better idea of "the way students process 
information" — learning styles. 

2. She responded "yes, the students have benefited." They have 
gained self esteem and confidence in being able to learn. They 
teach each other. They have not necessarily learned more math 
but they have learned more about themselves. "They are not as 
afraid to learn new things because they are not afraid of making 
mistakes. Therefore there is less fear in learning new 
concepts " 
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3 . Teacher "M" has gone from a 2 to a 5 in computer comfort 
level. She said she has become more fluent in using the 
computer . 

4 . She used the computers this past year in spurts as the need 
arose, especially in the beginning for basic skills. Then when 
they were covering fractions, she took the students everyday even 
for as short a time as fifteen minutes on certain days. 

5. The one positive event that has happened to her students is 
that they have increased in maturation of social skills. They 
help each other. She feels this has been extremely important for 
her students since they need these social skills in high school 
very badly in order to "make it" in the high school system. 

««N» 

1. Teacher "N" has become more individualized in his 
instruction, more systematic by using the pretests and diagnostic 
tests. He uses his instructional time better because he knows 
what skills have been mastered. 

2. He believes the students have benefited. He doesn't feel 
they have learned more since he is sure that everything he taught 
them has been given to them before. However, he does feel that 
they have "retained" more. 

3. He says he has gone from a 3 to a 4 in comfort level with the 
computer. He would, however, like to have the time to do more 
with the computer and be able to go in and change options for the 
students. 

4. His students used the computers for two mods at a time (84 
minutes) twice a week on a regular basis ax^ year. He would 
like to continue this type of schedule. 

5. One positive event from this is that the skill level for each 
student has become more concrete. "At the beginning of the year, 
when you read student records, it is very difficult to determine 
where they really are." He has used the task analysis to write 
skill levels for his students' lEPs. 

1. Teacher "0" said that the computer has been incorporated into 
the curriculum. It has become part of the weekly lesson. It is 
also used as a motivator often to get the students to behave. She 
said the students really like the computers. 

2. The students have certainly benefited from using the 
computers. She sees a marked improvement in the math area on the 
Woodcock Johnson The students are more independent in doing 
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classwork because they have learned the step-by-step procedure 
and it has carried over into the classroom. She uses the same 
approach in teaching as is used in a particular computer program. 

3. Teacher "0" has gone from a "0" to a "5". She always liked 
the idea of computers and her experience has reinforced this. 
She has a very positive attitude towards computers. 

4. This past year her students have been divided into four 
groups and one group goes to the computer lab everyday for two 
mods (84 minutes) . 

5. She has seen growth in the math area as indicated on tests 
and through observations. The students have incentive to do well 
in class. 

iipn 

1. Teacher "P" said she's more "analytical", due to the task 
analysis provided in the model. She said "the computers helped 
me to see exactly where the students were having a problem 
because r r. the immediate feedback [of the software]. During paper 
and pencil classwork, teachers often miss the errors." 

2. She believes the students have benefitted and are much 
more motivated to get it right when problems are presented on the 
computer, "something about them being up on the screen vs. the 
paper. " 

3. Her comfort level rating was a 1. She said she was 
fearful, and uncomfortable, but now after being trained by the 
project and taught how to "teach" with computers she said she 
learned a great deal about teaching even without computers. 
Based on the training on using computers, and how to use the 
materials and software, (especially on how to modify software 
with the teachers options) teacher "P" became so comfortable with 
them. The teacher management is easy to use and she said she 
would modify the software right with the students at the 
computer. For the students, she said "they feel special." 
Teacher "P" would tell them "Special just for you" when she 
modified the disks. The software responds right to the students 
individual needs. Some students figured out her set up and 
commented on the difficulty levels she set for them, for ex. "You 
didn't set this up right, this is too easy." 

4. Teacher "P" will be teaching a self contained class next 
year and plans to use the model as her math curriculum. 

5. Positive Event: Kids have a "hands on" to math and it is 
excitable and enjoyable for them. 

I.QM 
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1. Math has always been her favorite subject and she sets out 
to convince her students that it will be their favorite subject 
tooi Teacher "Q" said by the end of the year it does become 
their favorite. This year she used software to help with a 
concept when she ran into difficult times. Technology helps. 
Instead of doing things manually, she uses technology for 
"remediation. " 

2. She said yes, the students have benefited. They are 
enthusiastic, motivated and they ask for software when running 
into problems in other classes. 

3. Teacher "Q" was ctlways comfortable with computers but not so 
much so in math until the project. She became aware of the 
materials available for Math and then for other areas as a result 
of the project. She gave herself a comfort rating of 3. 

4. In the coming year, "Q" plans to continue using the 
materials as she has this year. 

5. Positive Event: Students are asking for helpl "Kids are 
more aware of when they need help. Before they didn't even know 
where they were lacking. Now they say *I'm having problems in 
this, can I work on the computer and get some practice?'" 

"R" 

1. Teacher "R" said that this program is so new and different. 

2. He said he believed that the students benefited, 
"absolutely" . 

3. His level of comfort before this project was a 1. 

He was completely new to computers. He said he feels very 
comfortable with ther now and sees the potential for their use in 
all areas of the cui -iculum. 

4. He sees them being used as much as physically possible with 
all the kids in the school next year. 

5. P^^sitive event: Generally the teachers have become more 
computtjr literate and so the entire school has benefited by 
integration of computers into the math curriculum. 
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